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PREFACE 


Tb*  work  rcportod  htrt  was  accomplishad  undar  Contract  Number  T30602- 
75>C-0330  undar  aponsorahip  of  the  Roma  Air  Davalopment  Canter  (RADC).  The 
principal  objective  of  thla  project  was  to  develop  mathoda  for  handling  credi- 
bility and  consistency  aspects  of  data  in  an  intalligence  aystem  with  advanced 
inference  capabilities.  It  is  directed  in  particular  to  the  Scientific  and 
Technical  Intalligance  System  (STIS)  being  developed  at  the  Air  Force  Foreign 
Technology  Division  (FTD).  The  report  was  prepared  by  Robert  Dickson  and 
Jerome  Sable  of  AAl  (AUERBACH  Associates,  Inc.).  Mr.  Ken  Roae  was  also  part 
of  the  project  team  and  devaloped  theoretical  aspacts  of  this  work  (e.g..  Appendix 
B).  Grateful  acknowledgement  la  given  to  Edward  Stull  of  FTD  and  Robert  Ruber ti 
of  RADC.  Dr.  Sable  was  tha  Project  Manager. 

In  a separate  task  eamsaded  to  this  contract  AAX  has  modified  the 
LISP  oystoB  for  the  UMIVAC  1110  Computer  to  make  it  more  suiteble  for  laplemen- 
tatloB  of  new  vereione  of  STIS.  This  work  is  also  reported  in  this  volume. 
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EVALUATION 


Functional  daalgn  spaclflcatlons  for  ncchoda  of  handling  Che  credibility 
and  conaiatcncy  of  facta  in  an  intelligence  data  baae  have  been  delivered 
under  Contract  F30602-7S-C-0330.  Whan  inpletiented  aa  an  adjunct  to  an 
intelligence  information  ayatem,  theae  methoda  will  enhance  analyat- 
inferential  capabiliciea.  Future  application  of  theae  methoda  ia  planned 
for  the  Scientific  and  Technical  Information  Syaten  (STIS)  at  the  Foreign 
Technology  Divialon.  Thia  developaMnt  ia  included  aa  part  of  TPO  No  3, 
Indicationa  and  Warning. 

0 A.W.'K 

ROBERT  N.  RUBERTI 
Project  Engineer 
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SECTION  1.  INTRODUCTION 


The  intelligence  enelyst  oust  often  cope  with  lerge  voluaes  of  in- 
foraatlon  which  he  usee  as  clues  to  construct  a true  representation  of  the 
state  of  affairs  in  the  real  world.  As  he  attesipts  to  build  a description 
of  the  entities  which  he  is  interested  in,  the  analyst  often  finds  that  they 
are  richly  Interrelated  and  that  the  description  of  a C3rplcal  entity  is  quite 
fragwentary.  Cosipounding  his  problea  is  the  fact  that  the  entities  he  is 
attenptlng  to  describe  are  usxially  not  perceived  directly  but  are  known  only 
through  reports  and  sensors  with  various  levels  of  credibility  and  accuracy. 

Under  sponsorship  of  Rowe  Air  Developnent  Center,  AUERBACH  Associates, 
Inc.  (AAZ)  has  been  studying  the  problen  of  Intelligence  data  processing,  and 
developing  advanced  data  structures  and  Inference  techniques,  and  assisting 
the  Air  force  foreign  Technology  Division  (FTD)  in  developing  an  advanced 
intalligenee  systea  called  8TI8  (Scientific  and  Technical  Intelligence  System). 
AUowlag  the  analyst  to  enter  general  rules  and  credibility  Judgements,  in 
addition  to  explicit  facts,  and  providing  a capability  to  derive  implicit  re- 
sults, raises  new  questions  concerning  information  credibility  and  consistency 
which  are  addressed  in  this  report. 
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1.1 


OBJECTIVES 


The  objectives  of  this  project  vere  to: 

(e)  study  and  develop  a oethodology  for  representing  the 
credibility  of  infomation  in  the  STIS  data  base  and 
the  results  derived  from  Itj 

(b)  develop  a methodology  for  determining  the  logical 
consistency  of  delineated  subsets  of  facts  and 
rules  in  the  STIS  data  base, 

(c)  augment  the  LISP  system  for  the  UNIVAC  1100  series 
computer  to  provide  a more  suitable  Implementation 
language  for  advanced  STIS  capabilities. 

This  work  was  carried  out  in  the  context  of  STIS  as  it  is  being 
developed  through  the  effort  of  FTD,  with  support  from  AAI.  In  particular, 
this  work  is  consistent  with  STIS  information  structures  and  inference  strategies. 

1.2  BACKGROUND 

Sns  provides  an  advanced  capability  for  the  analysis  of  intelligence 
infonnatlon.  It  Is  based  on  a network  type  data  structure  which  pensits  rala> 
tionahips  among  entities  and  new  attributes  to  be  freely  defined  with  minimal 
impact  on  previously  stored  data  and  programs.  Because  of  this,  it  is  particu* 
lorly  suited  for  capturing  fragmentary  information  which  is  undergoing  colla- 
tion processing,  analysis,  evaluation,  and  synthesis  into  finished  intelligence. 

A description  of  the  STIS  information  structure,  called  the  Concept  Net,  is 
given  in  Appendix  A to  this  report. 

In  another  effort,  AAI  developed  the  design  of  advanced  relational 
data  and  inference  providing  tools  for  use  in  an  operational  intelligence  en- 
vironment. It  is  expected  that  STIS  will  be  used  as  a vehicle  with  which  to 
develop  and  test  operations  on  relations,  inference,  end  consistency  determin- 
ing functions.  The  ultimate  goal  is  to  Incorporate  these  sdvanced  capabilities 
Into  STIS  so  that  their  effectiveness  can  be  accurately  evaluated,  and  these 
new  tools  can  be  provided  to  the  STIS  analyst. 
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AAI  has  davalopad  tha  daslgn  of  an  Infsrsnct  capability  for  STIS  at 
FTD.  An  initial  approach  to  tha  darlvatlon  of  bounds  on  tha  truth  valuaa  of 
darivad  rasults  was  davalopad  (Sabla)  and  axtansions  to  that  aathod  ara  das- 
crlbad  in  this  raport.  Claarly,  the  ultlnsta  cradibllity  and  consistency 
scha«a  will  have  to  be  closely  Intagratad  with  tha  inference  capability  and 
other  STIS  ■schanlsas  currently  being  developed. 

1.3  SOUS  OF  CKEOIBILITf  AWD  CONSISTESCT  IH  IMT£U.ICENCE  AHALYSIS 

The  art  of  intelligence,  by  its  very  nature,  is  intlnatoly  concerned 
with  data  of  variable  and  sonctlnes  unlatown  accuracy.  The  analyst  is  confronted 
with  a two>stsge  problem.  First,  hs  oust  discern,  from  the  data  at  hand,  what 
is  the  most  likely  state-of>sffoirs  In  the  real  world,  and  how  accurate  and 
cooplsto  that  picture  is  apt  to  be.  Second,  he  must  use  the  inferential  tools 
at  his  disposal,  both  formal  (deductive  and  inductive)  and  intuitive,  to 
estimate  tha  implications  of  the  current  statc>of-affairs  relative  to  particu* 
lar  questions  facing  him.  Tlie  questions,  often  of  a composite  nature  and  not 
inaediately  evident  from  the  current  state*of-af fairs,  may  bo  one  or  more  of 
the  following: 
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0 Does  the  current  state>of>affsirs  represent  a 
significant  (unexpected)  departure  from  a prior 
ttote-oC>af fairs? 

• Does  it  represe:it  a significantly  new  level  of 
cnenv  capability? 

a What  developacnt  directions  ore  indicated  «>d 
further  eapnbilltles  implied? 

a How  does  it  compare  with  our  own  capabilltiesT 

• What  does  it  imply  about  the  eneaqr's  plans  snd 
■otivest 

0 Does  it  represent  a threat  (tachnologteal  or  other* 
wise)  to  oursslvos? 

Clearly,  these  questions  cannot  be  answered  automatically  with  today's 
Imfeimetlon  technology.  The  objective  of  long  tern  Scientific  and  Technical  Intel- 
ligence System  (STIS)  developments  is  to  furnish  the  analyst  with  effective  tools  with 


I 
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which  to  build  and  naincain  a nodal  of  the  current  atate>of>affeirs  which  is  as 
realistic  and  complete  as  possible*  It  should  be  able  to  represent  "facts'* 

(with  his  Judgement  of  their  credibility)  in  terns  which  have  meaning  to  him, 
and  to  represent  plausible  rules  of  inference  and  their  level  of  credibility. 

An  Inferential  system  is  being  designed  which  may  make  it  possible  to  use  these 
kules  to  derive  la^llcit  facts  together  with  a boimd  on  their  credibility.  The 
facts,  rules,  and  steps  taken  in  the  inferential  process  will  be  displayed  to 
the  analyst  so  that  he  can  Judge  the  validity  of  the  process  and  the  credibility 
of  the  result. 

What  Is  meant  by  the  intuitive  notion  of  credibility  Is  itself  a 
complex  question  which  deserves  careful  development.  One  can  view  the  in- 
telligence observation  and  analysis  process  as  including  the  elements  shown  in 
Figure  1>1.  This  Is  the  event  input  chain  which  produces  "facts"  for  the  data 
base.  The  analyst,  besides  entering  these  facts,  must  Judge  their  credibility 
relative  to  the  current  state-of-affalrs  and  their  value  relative  to  current 
and  anticipated  questions  of  the  type  listed  above.  This  process  involves  a 
number  of  factors  Including  the  analyst's  evaluation  of  the  source  and  sensor, 
the  source's  evaluation  of  the  sensor,  and  the  quality  of  the  observetlon. 

Some  of  these  evaluations  by  the  originator  (source)  and  destination  analyst 
are  shown  in  Table  1 -l.  An  indication  of  how  these  and  other  factors  relate 
to  the  overall  evaluation  of  credibility  and  utility  (value)  by  the  analyst 
Is  given  in  the  Factor  Dependence  Tree  of  Figure  1-2.  This  diagram  attempts 
to  show  how  the  worth  of  a fact  or  report  can  be  considered  as  being  Influ- 
enced by  the  factors  of  relevance,  credibility,  and  analysis  or  assimilation 
level  and  how  credibility  and  other  factors  are.  In  turn,  influenced  by  more 
basic  factors  such  as  source  reliability,  accuracy,  consistency,  etc.  Clearly, 
It  is  ODreallstlc  to  believe  that  the  credibility  evaluation  process  can  be 
completely  formalised.  A less  naive  view  Is  that  seme  of  the  iaq>ortant  factors 
can  be  quantified  and  onoug))  information  made  available  to  the  analyst  so  that 
valid  Judgements  can  be  made. 
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TABLE  1-1.  INFORMATION  ASSESSMENT  FACTORS 


EVALUATION  OF 

SENSOR  OR  SOURCE 

FACT,  MESSAGE,  OR  RESULT 

Sensor  Precis ion 
Sensor  Accuracy 

Message  Precision 
Message  Accuracy 
Measage  TlaMliness 

Reliability 
Alertness/Sensitivity 
Doaa  in /Responsibility 

Sensor  Cspability 
Source  Bias 

Consistency 

Relevance 

Assiailation/Analysis 

Level 

Credibility 

Value 

SECTION  II 


SUMMARY 


This  projset  coasistsd  of  thrss  largsly  lodtpsndsnt  arsss: 

(1)  Tbs  SQslysiSt  qusntlficstion,  sod  cslculation 
of  ersdibility, 

(2)  Ths  aaslysls  of  fact /rule  conalatancy  in  a 
technical  ineelllgcncc  Concept  Net,  and 

(3)  Modification  of  the  LISP  prograoning  systaa  for  the 
UNIVAC  1110  to  Bake  it  aore  suitable  for  lapleawnta- 
tion  of  portions  of  8TXS. 

The  first  two  areas  involve  the  specification  of  procedures  which 
will  eoBtributs  iidiaraBt  intalliganes  analysis  capabilities  to  STIS.  The 
third  provides  an  additional  systaas  lapleaantation  tool  for  the  UNIVAC 


2.1 


CREDIBILITY  ANALYSIS 


2.1.1  Mathematical  Foundations  For  Handling  Credibility 

The  analysis  of  credibility  of  both  explicit  and  derived  information 
la  a complex  question  that  siay  be  approached  from  several  points  of  view, 
utilising  at  least  the  mathematical  models  of  probability  theory  and  multi- 
valued logic.  As  we  shall  see,  "fuzzy"  logic  (Lee)  is  a special  case  of  multi- 
valued logics.  We  examine  first  probability  theory,  then  multi-valued  logic 
as  a theoretical  foundation  (mathematical  model)  of  credibility. 

2. 1.1.1  Probability  Theory 

Credibility,  or  the  truth  value  of  a sentence,  can  be  viewed  as  an 
Interpretation  of  probability.  This  Interpretation  of  probability  Is  some- 
times called  Inductive  logic  (Carnap  and  Jeffrey),  the  logic  of  weight 
(Relchenbach),  or  more  conanonly  aubjectlve  probability.  It  has  been  applied 
to  the  problem  of  deteradnlng  the  probability  of  an  event,  given  reports  of 
the  event  of  various  reliabilities.  This  problem  has  been  examined  from  an 
Intelligence  analysis  point  of  view  by  (Kuhns)  and  by  (Johnson).  It  has  also 
been  examined.  In  a ax>re  general  scientific  and  behavioral  framework  by  (Shum), 
(Cavanagh),  and  (Snapper). 

Often  the  task  Is  formally  analogous  to  a problem  in  statistical 
inference,  where  items  of  evidence  or  data  are  used  to  determine  the  relative 
likelihood  of  alternative  hypotheses.  One  strategy  for  processing  data  in 
two  tasks  is  Bayes*  theorem,  a form  of  which  is  : * 

^•eRi>  <Hi<»D>  <H1> 

" 1 <Hi-*D>  <Hi> 
i 

* For  conciaeneas,  and  to  preserve  a parallel  with  deductive  logic,  we  use  the 
following  notation  in  this  report: 

<a>  la  the  probability  that  event  a occurs  (is  true),  usually  written  P(a). 

<i>  or  «ia>  is  the  probability  that  event  a does  not  occur  (is  false), 

<i>  ■ l-<a>. 

<tr*b>  is  the  conditional  probability  from  a to  b,  the  probability  that 
b occurs  given  event  a,  usually  written  P(b|a). 
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where  <ii>  ie  the  prior  probability  of  a particular  hypothaeia;  <Bi-^E>  is  the 
probability  of  the  oeeurranea  of  a particular  itesi  of  data  conditional  upon  the 
truth  of  a particular  hypothesis;  and  0-wHi>  is  the  posterior  probability  of  a 
particular  hypothisais  conditional  upon  the  occurrence  of  a particular  datum. 
Estprassad  in  thia  way,  the  astiaution  of  posterior  probability  is  seen  to  in- 
volve two  processes:  first,  the  determination  of  the  diagnostic  impact  of  each 

datum  (^i-wD>);  and  second,  calculation  of  the  posterior  probability  estimate 
(<D*«Hi>)  on  the  basis  of  the  observed  data. 

In  the  long  tarn  STIS  design  both  specific  information  and  general 
tulas  arc  stored  in  a relational  network  called  a Concept  Nat.  Both  the  specific 

information  (such  as  "facts"  describing  entities  and  their  Intarralationahlps) 
and  the  rules  are  associated  with  a probabilistic  swasura  of  their  truth  value 
called  credibility.  Rules  ara  entered  as  logical  isvlications  of  the  form 
e*^h  where  a and  h may  be  logical  propositions.  Typically  a is  a conjunction 
of  terms  (relations)  and  h is  a single  derived  relation.  The  credibility,  or 

strength,  of  rules  is  given  by  a pair  of  numbers  which  represent  the  conditional 
probabilities  (<e.^  h>,  <i.^  h>).  Given  the  existence  (or  derivabllity)  of  the 
premise  c with  credibility  <c>,  the  conclusion  h can  be  derived  with  credibility 
<h>  using  the  following  derivation. 

<h>  • <aAh>  + <a  Ah>«  <a>*<a->h>  + <a>*<i->h> 

The  credibility  <a>  represents  the  subjective  (prior)  probability  that 
the  premiae  is  true.  If  a Is  a compound  proposition,  its  credibility  can  be 
derived  from  its  components  using  the  laws  of  probability.  For  example  if 

a • *1^2  *1  *2 

ere  independent  then  <e>  ■ <ej^>*<e2>«  The  rule  strength  factor  <e->h>  is  the 

probability  that  the  conclusion  (hypothesis)  is  true  given  that  the  premise 
(evidence)  is  true.  The  rule  strength  factor  <i-^h>  is  the  probability  that 
the  conclusion  is  true  even  when  the  premise  is  false.  A rule,  which  produces 
a hypothesis  with  a high  credibility  may  have  a high  value  not  only  for  <e->  h>. 
Mowever,  an  effective  rule,  one  which  yields  an  hypothesis  of  high  credibility 
only  when  the  evidence  has  high  credibility,  should  have  a high  llkallhood  ratio 
<e  ^h>/<i*>  h>. 


V 


The  credibility  of  the  evidence  ie  enhanced  %dien  independent  reports 
of  the  eaae  event  are  received.  If  we  let  represent  a report  of  event  e 
from  source  then  the  conditional  probability  e>  represents  the  credi- 

bility of  e due  to  the  single  report.  If  two  independent  sources  end  $2 
report  an  event  e then  its  denial  i occurs  only  if  both  reports  are  false. 

This  occurs  with  probability  <E2*^  S>*<E2“>  8>.  The  probability  of  the 
occurrence  of  e is  given  by  “ l-<E^->  e>*<E2->  e>.  This  can  be 

generalised  to  n independent  sources  as  follows. 

n n _ 

<A  Ej-^  e>  • 1- n <E^-^e>. 

i-1  i-1 

Data  reliability  can  be  incorporated  into  the  Bayesian  framework  as 
another  stage  in  the  inference  process.  First,  we  must  differentiate  between 
the  actual  occurrence  of  a datum  (D)  and  the  report  of  its  occurrence  (D*). 
Assuming  that  the  report  of  an  event  is  not  contingent  upon  which  hypothesis 
is  true,  the  conditional  relationship  between  the  data  and  the  hypothesis 
can  be  deeonposed  into: 

<Hi^D®>  - <D-»D®>  <Hi-»B> 

where  0*^D^  is  the  probability  of  a report  of  some  datum  conditional  upon  the 
actual  occurrence  of  that  particular  datum;  0*vD'*>  is  the  probability  of  a 
report  of  some  datitm  conditional  upon  the  actual  occurrence  of  any  other  datum; 
<Hi-*D>  is  the  probability  of  the  occurrence  of  any  other  datum  conditional 
upon  the  truth  of  a particular  hypotbbsis;  and  <Ri-*E>  is  as  defined  pre- 
viously. Note  that  equals  l-^i<^E>.  Expressed  in  this  way.  the 

determination  of  the  diagnostic  impact  of  a report  of  some  datum  involves  two 
processes,  given  a detendnation  of  source  relisbility  first, 

determination  of  the  diagnostic  impact  of  the  reported  datum  <Ri-vD>  and  the 
diagnostic  iaipact  of  other  data  not  reported  <Hi'^D>  : and  second,  calculation 
of  the  diagnostic  iaqpact  of  the  report  ^i-vD®>  on  the  basis  of  its  reliability. 

2.1.1.2 

Another  valid  Interpretation  of  credibility  is  the  degree  of  truth  in 
a wltl-valued,  or  fussy,  I6gie.  Pussy  logic  is  developed  by  (Lee)  from  the 
notion  of  fussy  sets  of  (Zadeh).  A fussy  set  is  a set  of  ordered  pairs 


in  which  represents  the  grade  (degree,  or  credibility)  of  swinbership  of 
•lesient  e^  in  set  A,  0 ^g^  < 1,  i • 1,  •••,  n. 

Tussy  Logie  is  a generalisation  of  normal  two*valued  logic  in  which 
a truth  value  T(P)  in  the  interval  (0,  1)  is  assigned  to  each  elementary  prop- 
osition P in  the  premise  of  a deduction  and  a truth  value  T(C)  is  derived  for 
•ach  eonaequent. 

The  use  of  fussy  logic  to  determine  the  credibility  of  derived  results 
in  the  inference  system  being  developed  for  STIS  was  discussed  in  the  Final 
Report  of  the  BIAS  Augmentation  Study  (Sable). 

There  have  recently  been  developed  problem-solving  systems  based  on 
fussy  logic.  These  include  FUZZY  PLANNER  (Kling),  an  extension  of  the  problem- 
solving language  PLANNER,  and  FUZZY  (La  Faivre)  a programming  languaga  for 
problem-solving  istplemented  in  USP. 

2. 1.1. 3 Comparison  of  Probability  Theory  and  Fussy  Logic  as  Models  for 

Credibility 

Both  the  subjective  probability  and  fussy  logic  interpretations  of 
credibility  are  valid  and  have  their  legitimate  roles  in  the  overall  intelligence 
analysis  process.  The  credibility  of  atomic  events  (facts)  can  be  estimated  by 
the  analyst  using  one  or  more  of  the  following  methods: 

(1)  directly  estimated  as  a subjective  probability, 

(2)  using  a weighted  factor  tree  such  as  that  given 
in  Figure  1-2,  or 

(3)  using  subjective  assessments  of  a number  of 
auxiliary  probabilities  such  as  the  a-priori 
likelihood  of  the  event,  and  the  perceived  reli- 
ability of  the  sources  reporting  events,  compute 
the  probability  of  the  event  in  the  smnner  of 
Bayes  as  given  by  (Kuhns). 
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The  choice  of  tihlch  method  to  use  should  probably  be  left  to  the 
analyst  and  will  depend  on  the  confidence  he  feels  In  making  the  judgement  and 
the  difficulty  of  carrying  out  the  laiplled  computations.  Method  (2)  can  con- 
sider all  factors,  and  Is  probably  more  closely  allied  (than  Is  method  (3))  to 
,the  method  used  Intuitively  by  the  analyst  when  he  uses  method  (1).  In  method  (3) 
certain  factors  will  appear  only  laipllcltly  in  subjective  probabilities  rather 
than  explicitly  as  in  method  (2).  Examples  are  such  considerations  as  the 
source's  estimate  of  the  accuracy  or  capability  of  the  sensor,  the  signal-to- 
ooise  ratio  in  the  observation,  etc.  On  the  other  hand,  the  analyst  may  feel 
it  is  easier  to  make  judgements  of  the  auxiliary  probabilities  of  method  (3) 
than  the  direct  judgement  of  credibility  of  method  (1)  or  the  assignment  of 
waists  of  method  (2).  Some  light  may  be  shed  on  this  question  by  experimental 
work  in  analyst  performance  being  conducted  by  the  Amy  Research  Institute  for 
the  Behavioral  and  Social  Sciences  (Levine). 

The  above  estimation  of  the  credibilities  of  atomic  facts  and  simple 
hypotheses  is  carried  out  quite  independently  of  the  theory  of  fuzzy  logic. 
However,  once  these  basic  credibility  assessments  are  made  the  situation  is 
quite  different.  Fuzzy  logic  is  the  appropriate  tool  for  placing  upper  bounds 
on  the  credibility  of  coispound  or  derivable  propositions. 

Consider  the  structure  of  the  Semantic  Hat  in  STIS.  Here  we  store 
lists  of  entities  which  arc  members  of  various  sets,  either  system  sets  or  the 
sets  defined  by  the  values  of  other  attributes.  List  intersection  will  be  a 
basic  operation  performed  to  narrow  the  search  for  entities  with  a desired 
combination  of  properties.  If  we  consider  these  lists  as  sets  of  ordered 
pairs  (g^/«^)  consisting  of  msmbsrship  grade  (credibility)  and  entity  identifier , 
then  the  intersection  of  two  lists  will  be  a list  of  ontities  which  appear  on 
both  lists,  along  with  their  mea6crship  grades.  According  to  the  rules  of 
fuzzy  logic,  this  will  be  the  smaller  of  the  two  credibilities,  a simple  selec- 
tion. For  a Slagle  example  of  set  intersection  using  fuzzy  logic,  see  Figure  2-1. 


Unfortunately,  the  probabilletlc  approach  requlraa  the  eatlaation  of 
relative  (conditional)  probabilities  in  addition  to  the  probabilitica  of  atotnic 
events.  For  example  the  probability  of  the  conjunction  of  two  R/ents  A and  B 
la  the  probability  of  A multiplied  by  the  relative  probability  from  A to  B. 

<AaB>  - <A>  • < A-^B  > 

It  Is  clearly  an  excessive  burden  to  store  all  possible  relative 
probabilities  in  order  to  perform  an  arbitrary  aet  interaection.  It  ia  even 
more  impractical  to  expect  the  analyst  to  estimate  them.  This  problem  is 
compounded  in  the  case  of  complex  derivations  which  may  go  through  aeveral 

steps. 

On  the  other  hand,  the  fussy  logic  truth  value  can  be  easily  computed 
from  the  credibility  of  each  premise.  The  derived  truth  value  will  be  an  upper 
bound  of  the  credibility  (subjective  probability  or  betting  quotient)  of  the 
derived  result.  (A  lower  bound  can  be  derived  with  an  assumption  of  logical 
or  probabilistic  independence.  The  lower  bound  is  then  the  product  of  the 
credibilities  of  the  constituents.) 

An  examination  of  approaches  to  estimating  the  probabilities  of  events 
which  can  be  specified  as  compound  propositions  is  given  in  Appendix  B. 

2.1.2  Representation  of  Data  Credibility 


A fact  in  SnS  is  the  statement  that  a given  entity  has  a certain 
value  for  a given  attribute,  e.g,.  Location  (Ml)  • Moscow,  or  Range  (M2)  “ 
2000  ni«  In  order  to  be  able  to  meaningfully  associate  a credibility  with  a 
fact,  the  accuracy  of  the  stated  value  must  be  given,  estimated,  or  implicit. 
This  holds  for  attributes  with  linguistic  values  like  location  and  color,  as 
well  as  attributes  with  numerical  values  like  range  or  coordinates.  Thus  the 
statement  Cred  (.6)/Range  (M2,  2000  t 300)  means  that  the  probability  that  the 
range  of  M2  is  between  1700  and  2300  is  .8  (and  .2  that  it  is  not).  If  the 
accuracy  is  not  given  then  it  may  be  implicit  (from  the  miaaile's  generic 
description  in  the  ST18  Entity  Net)  that  this  is  a "2000  mile  class" 
missile.  This  is  meaningful  only  if  the  extent  of  the  class  (say  1500 


to  2500  miles)  is  slso  known,  and  can  ba  taken  as  the  accuracy  of  the  statement. 
Notice  that  if  range  is  an  indexed  attribute  the  credibility  of  the  set  member- 
ship of  m2  in  a given  value  interval  set  depends  on  the  Interval  as  well  as  the 
fact,  accuracy,  and  credibility.  For  example,  if  the  value  intervals  Indexed 
were  aero  to  1000,  1000  to  2000,  2000  to  3000,  etc.,  M2  would  be  placed  in 
both  the  1000  to  2000,  and  2000  to  3000  catagories  with  membership  grade  of  .5. 

The  specification  of  the  value  of  a numerical  attribute,  and  Its 
tolerance,  is  In  effect  specifying  the  statistical  distribution  of  values  one 
might  expect  if  the  attribute  were  subject  to  repeated  sensing.  Once  this 
distribution  is  established,  one  can  then  determine  the  probability  of  the  value 
falling  in  a given  interval.  For  example,  if  we  assume  that  the  maximum  range 
of  missile  M2  is:. a random  variable  with  a normal  (Gaussian)  error,  and  establish 
that  its  expected  value  (mean)  is  2000  miles  with  a standard  deviation  of  300 
miles,  then  the  probability  of  a particular  member  of  that  class  of  missiles 
having  a rsnge  of  greater  than  1700  miles  is  0.84.  Another  way  of  stating  this 
is  that  missile  M2  is  a mesiber  of  the  set  of  missiles  with  range  greater  than 
1700  miles  with  a fuzzy  aet  membership  grade  of  0.84. 

This  concept  carries  over  directly  to  attributes  which  have  linguistic 
categories  rather  than  numbers  as  valuas.  For  example,  the  statement  that  the 
location  of  Ml  is  Moscow  with  credibility  equal  to  0.8  could  be  accepted  to  mean 
that  Ml  lies  somewhere  in  a geographic  area  80%  of  which  is  included  in  the 
{ geographic  araa  known  as  Moscow,  its  grade  of  membership  in  Moscow  is  .8,  or 
other  consistent  interpretations. 


Very  often,  especially  when  the  attribute  is  specified  as  a linguistic 
category  (Moscow,  red,  long  range,  etc.),  the  uncertainty  or  credibility  is 
also  axpressed  as  a linguistic  category  or  probability  phrase  (probable,  likely, 
certain,  etc.).  Recent  studies  (Johnson)  have  shown  that  it  is  feasible  to 
convert  such  categories  to  a numerical  scale  with  a high  degree  of  consistency 
within  the  intelligence  coonunity,  and  that  tha  encoding  of  these  probability 
phrases  into  numerical  equivalents  is  not  appreciably  influenced  by  sentence 
context. 
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2.1.3 


Calculation  of  Statistical  Errors  of  Derived  or  Hvpothetlzed  Values 


The  intelligCDCC  analyst  often  finds  hlawelf  in  the  position  of 
making  a decision  concerning  enemy  capability  or  technological  threat  based  on 
Information  which  is  imprecisely  known.  (The  chain  from  observed  event  to 
decision  was  illustrated  in  Figure  1-1. ) It  is  as  though  each  newly  observed 
and  reported  event  generates  implicitly  a host  of  questions  such  as  those 
listed  in  Section  1*3.  When  the  decision  can  be  posed  as  a logical  criterion, 
and  where  the  observed  or  derived  event  parameters  can  be  posed  as  statistical 
distributions,  then  it  Is  reasonable  to  investigate  the  feasibility  of  associ- 
ating error  probabilities  of  Type  I and  Type  II  with  each  of  the  hypothesized 
decisions. 

In  the  simplest  case,  consider  the  following  scenario: 

(a)  a series  of  events  has  been  observed 
(e.g. , missile  firings), 

(b)  a parameter  (e.g.,  accuracy)  is  estimated  as  a 
statistical  distribution, 

(c)  a particular  interval  of  the  value  of  the  para- 
meter (e.g.,  less  than  1000  yards)  is  chosen  as 
a critical  region,  within  which  a technological 
threat  is  indicated. 

The  question  facing  the  analyst  is  whether  a particular  sequence  of 
observations  indicates  that  a technological  threat  exists,  i.e.,  should  he  (or 
should  he  not)  "sound  the  alarm".  The  possible  real-world  states  and  analyst 
responses  are  illustrated  in  the  decision  matrix  shown  in  Table  2-1.  A ' 
hypothetical  distribution  function  for  the  parameter  is  shown  in  Figure  2-2. 

The  decision  as  to  whether  or  not  to  "sound  the  alarm"  is  a problem  in  decision 
theory  and  depends  upon  the  cost  of  a "false  alarm"  or  "being  asleep"  relative 
to  the  value  of  a correct  decision  of  the  situation  being  critical  or  non- 
crltical. 


0 


1000 


2000 


3000  4000 

Accuracy  (x)  (yards) 


Unfortunately,  the  situation  ia  rarely  thia  alaple.  When  a critical 
situation  can  be  fonally  defined  it  is  usually  a conposltc  condition  or  a 
functional  relationship  such  as: 

Threat  ■ |(accuracy  < 1000  yds  and  yield  > 1 MT) 
or  (accurecy  < 2000  yds  and  yield  > 2 HT)J 

It  is  feasible  to  associate  error  probabilities  and  fonal  decision 
■echanisas  for  realistic  criteria  (such  as  the  above)  and  for  data  values 
statistically  derived  or  aanually  hypothesised. 

2.1.4  Calculation  of  Credibility  of  Derived  Inforaation 

As  part  of  early  intelligence  systea  studies.  AAl  developed  two 
algorithas  for, inferring  (deriving)  iaplicit  Inforaation  froa  a data  base  con- 
taining both  facts  (relations)  and  rules  (conditional  stateaents  in  a subset 
of  the  first-order  predicate  calculus)  (Sable).  The  first  algoritha,  Subaoal 
Generator  with  Staae  Preference,  is  a top-down  problea-solver  with  a cost- 
driven  search  strategy,  and  the  second,  Subaoal  Generator  with  Path  Preference, 
is  a .bottoi^iV  problea-solver  with  a cost-driven  search  strategy.  Recent  ad- 
vances in  autoaatic  problemsolving  and  tbeorea-provlng  (Kuehner,  Kowalski, 
VanderBrug)  have  developed  ways  of  conbining  top-down  and  bottomup  approaches 
to  laprove  aearch  efficiency.  We  have  taken  advantage  of  these  sdvances  and 
have  developed  a detailed  design  of  a deductive  systen  (Coldhirsh  and  Carson). 
Along  with  the  inference  algorithas,  the  earlier  project  outlined  the  use  of 
fussy  logic,  as  developed  by  (Lee)  as  a potential  aethod  of  deteraining  the 
truth  value  of  derived  results.*  This  fussy  logic  truth  value  is  an  easily 
coaputed  function  of  the  credibilities  of  the  facts  and  rules  used  in  the 
preaise  of  the  deduction  and  serves  as  an  upper  bound  to  the  credibility  of 
the  Inferred  result  (when  interpreted  as  a subjective  probability).  This  avoids 
the  coaputatlon  of  the  subjective  probability  of  the  consequent  given  the 
probability  of  the  antecedents,  a coaputatlon  that  Involves  not  only  the  basic 
credibilitlas  but  also  conditional  (relative)  probabilities  which  arc  often 
unknown. 

e 

J.  Sable:  Design  Concept  for  an  Augmented  Relational  Intelligence  Analysis 

System.  RADC-TRr73-342,  pp  6-14  to  6-18,  (773189). 
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Xhc  of  aubjoctlv*  probabilitic*  ••  ercdibllltioa  of  derived  re- 
eulct  become*  tractable  if  it  is  assuawd  that  the  atomic  facta  arc  statistically 
independent  (an  assunptioo  which  is  not  generally  valid).  In  that  ease  the 
computation  of  probability  of  truth  depends  only  on  the  individual  credibilities 
of  the  premises.  This  probability  is  in  general  lower  than  the  fuzry  logic 
truth  value  and  can  be  taken  as  a lower  bound  of  the  rigorous  credibility  Of 
the  derived  result. 

2. 2 COWSISTCNCY  TCSTTNG 

The  consistency  of  the  SnS  data  base  is  a complex  and,  in  many  ways, 
a subtle  problem  which  involves  an  interplay  of  each  of  the  elements  of  the 
Concept  Hct:  The  Entity  Net,  the  Semantic  Net,  and  the  Rules  Net.  The  problem 

is  engendered  by  the  following  properties  of  STIS  and  the  Concept  Net: 

(a)  Specific  facts  (extensional  statements)  arc  stored 
in  the  Entity  Net. 

(b)  General  rules  (intentional  statements)  which  apply  to 
apecified  classes  of  entities  and  relations  (or  entities, 
attributes,  and  values)  are  stored  in  the  Rules  Net. 

(c)  The  partial  ordering  (subset)  relationships  which  exist 
among  sets  occurring  as  values,  and  the  set  membership 
relationship*  which  exist  between  set  terms  and  entities 
are  stored  in  the  Semantic  Net. 

(d)  There  will  be  a system  capability  to  derive  implicit  facts 
from  explicit  rules  and  fact*. 

We  say  a set  of  statements  (rules  and  facts)  is  inconsistent  if  we 
can  derive  from  it  both  a new  atateamnt  and  its  negation  using  valid  rule* 
of  infaranee.  This  consistency  condition  is  easy  to  state  and  in  fact  one 
can  guarantee  a formally  consistent  data  base  by  attesq>ting  to  derive  the 
negation  of  each  statamant  at  it  is  entered  into  the  data  base.  A strategy 
for  doing  this  is  outlined  in  Appendix  E.  However,  the  consistency- testing 
process  is  complicated  by  the  set  inclusion  and  membership  relations  of  the 
Semantic  Mat  and  the  temporal  relationships  which  qualify  facts  in  the  Entity 
Met. 
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2.2.1  lUnM  Tot  Operations 


Th«  aiiAlysls  of  whether  intervals  in  space,  tine  or  other  netric  di' 
nensions  overlap  is  often  crucial  in  establishing  the  consistency  of  sets  of 
atatenents.  Because  of  this  the  design  of  the  node  in  the  STIS  Concept  Net 
^lo%«s  any  fact  (attribute/value  pair  in  an  entity)  to  be  qualified  by  inter- 
vals of  validity,  in  terns  of  accuracy  or  tenporal  relations. 


In  order  to  clarify  these  notions  consider  the  following  examples  in 
which  the  relation  following  the  slash  qualifies  the  preceding  relational  state- 
ment: 

(Bange  (M2,  2000)  / Accuracy  (300),  Era  (1972,  1974) 

Range  (M2,  1700)  / Accuracy  (300),  Era  (1973,  1975) 

Range  (x,  y)  A Range  (x,a)  A Overlap  (Era,y,*)^ 

Overlap  (Range,  y,  z) 


Accuracy  and  Era  are  value  qualifiers  which  specify  the  interval  of 
validity  of  a value  in  terns  of  numeric  range  and  time  respectively.  Overlap 
is  a system  predlcste  which  takes  three  arguments,  s qualifier  (e.g..  Accuracy 
or  Era),  and  two  values  (or  variables  standing  for  those  values).  Overlap  is 
true  if  the  intervals  of  validity  of  the  values  of  its  second  and  third  domain 
elements  have  a non-zero  intersection  with  respect  to  the  qualifier  named  in 
the  first  domsln  element.  It  is  false  if  the  two  intervals  do  not  overlap. 

Thus  Example  (1)  is  a consistent  set.  (It  would  be  inconsistent  if  the  range 
tolerances  were  1 100.) 

1(2.1)  Loc  (El,  Philadelphia)  / Era  (1972,  1974) 

(2.2)  Loc  (El,  Harrisburg)  / Era  (1973,  1975) 

(2.3)  Loc  (x,y)  A Loc  (x,  z)  A Overlap  (Era,  y,z)^ 

Overlap  (Loc,y,z) 

- Loc  (El,  Philadelphia)  / Era  (1972,  1974) 

(3)  I Loc  (El,  Penna)  / Era  (1973,  1975) 

l*Loc  (*,y)  A Loc  (x,  s)  A Overlap  (Era,  y,z)=> Overlap  (Loc,  y,  z) 

{Loc  (El,  Philadelphia)  / Era  (1972,  1973) 

Loc  (El,  lerrisburg)  / Era  (1974,  1975) 

Loc  <x,y)  A Loc  (x,  z)  A Overlap  (Era,y,s)z>  OverUp  (Loc,y.s) 

Example  (2)  la  incenaistent  because  by  Instantiating  X"E1,  y«Phlladelptila, 

s*larriabttrg,  we  cam  derive  the  negation  of  (2.3)t 

(2.4)  Loc  <x,y)  A loc  (x,s)  A Overlap  (Bra,y,s)  A OverUp  (Loc,y,z) 
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Exanpl*  (3)  is  a consistent  set  because  with  the  above  inatantiatlon 
and  uae  of  the  Seawntlc  Net  we  can  determine  that  y and  z (Philadelphia  and 
Penna)  have  a non-zero  interaection  (Philadelphia  is  given  as  a subset  of  (Penna), 
and  (2.4)  cennot  be  derived. 

Example  (4)  is  a consistent  set  becauae,  with  the  aame  instantiation. 
Overlap  (y,z)  is  false,  their  interval  of  validity  (Era)  does  not  overlap,  and 
(2.4)  cannot  be  derived. 

The  relation  Overlap  Invbkee  a generalised  range  teat  operator 
which  determines,  from  subset,  accuracy,  and  temporal  relationships  whether 
there  ia  an  overlap  in  the  Interval  of  validity  of  apecified  atatemanta.  It 
ia  important  to  realize,  however,  that  the  Overlap  operator  muat  be  invoked 
by  a rule  and  cannot  be  invoked  aucooiatically  aince,  in  general,  multiple 
valuea  for  a given  attribute  may  net  imply  an  anomaly.  For  example,  defenaive 
mlaailea  and  offenalve  miaalles  may  both  be  aubaeta  of  the  ayatem  aat  miaailes, 
yet  a given  mlaalle  may  be  categorised  as  both  offensive  and  defenaive.  That 
la,  the  aubaeta  of  a given  set  are  net,  in  general,  mutually  exclusive  (see, 
for  exaaiple,  figure  2-1). 

2*2.2.  Determinina  Factual  Anemaliea  with  Specialized  Proarama 

The  question  remains  whethar  or  not  taata  for  determining 
anoamlies  in  factual  information  should  inv^ie  a consistency  test  using 
the  general  derivation  mechanism.  This  may  be  too  costly  a amchanism  in  moat 
Instances  and  it  any  be  more  effective  to  develop  specific  program  procedures 
for  verifying  the  consistency  of  factual  information  in  restricted  areas  of 
the  Entity  Nat  defined  by  STIS  users.  The  determination  of  whethar  specialised 
fact  consistency  prograaw  should  be  developed  will  depend  on  the  efficiency  of 
the  general  inference  routines  relative  to  the  proposed  specialised  routines 
and  on  an  analysis  of  specific  consistency  problems  associated  within  a subset 
of  the  grxs  data  base  oriented  to  a specific  problen  area.  This  determination 
will  be  carried  out  in  coordination  with  the  8TXS  data  base  managers,  system 
developers,  and  users. 


2.2.3  Limited  Rules  Consistency  Te«ttnK 


There  le  no  general  methodology  for  completely  testing  %ihether  e set 
of  rules  (intentional  statements)  Is  consistent.  Although  the  inconsistency 
of  a set  of  statements  can  be  demonstrated  if  It  permits  both  a statement  and 
its  negation  to  be  derived,  there  is  no  guaranteed  general  way  to  discover  that 
this  pair  might  exist.  It  is  even  impossible,  in  general,  to  conclusively 
•tate  that  a given  stateoient  cannot  be  derived,  since  a derivation  procedure 
will  usually  be  prematurely  terminated  due  to  exhausting  some  given  resource 
(time  and/or  space)  limit.  (There  will,  of  course,  be  instances  In  which  it 
can  be  demonstrated  conclusively,  through  successful  exhaustion  of  possi> 
bllltles,  that  a given  statement  cannot  be  derived  from  a given  set  of 
axiom,  and  is  therefore  deductively  independent  of  those  axioms.) 

Although  complete  self-consistency  of  a set  of  axioms  is  difficult  to 
establish  in  general,  the  restricted  form  in  which  it  Is  proposed  that  rules 

be  stated  in  8TIS  makes  It  possible  to  perform  a limited  type  of  rules 
consistency  tasting.  A rule  In  8T1S  will  have  the  form 

^*1 M Y'j 

That  is,  a eonj^xnction  of  antecedents  (Ai)  implies  a disjunction  of 
consequents  (Cj).  It  Is  expected  that  most  rules  will  have  a single  consequent. 
The  occurrence  of  rexations  in  rules  will  be  completely  indexed  in  the  Rule 
Met  so  that  all  rules  which  have  a given  relation  in  the  antecedent  or  conse- 
quent can  be  easily  retrieved  and  Inspected.  This  will  make  it  possible  to 
detect  rules  tihich  are  insedUtely  contradictory  (due,  for  example,  to 
inadvertent  errors). 

A lladted  rules  consistency-testing  program  which  will  detect  at 
least  the  following  actions  can  be  specified  (in  sequence): 

(1)  In  ionsral,  each  binary  relation,  A will  have  a converse  b 
so  that  or  A(x,y)  - B(y,x). 
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On*  of  those,  eey  A,  will  be  considered  the  primary  form  and 
A(x,y)  will  be  substituted  for  B(y,x)  in  ell  rules.  (Rules 
defining  converse  relations,  transitivity,  and  set  siembershlp 
inheritance  will  be  transfortned  and  stored  in  special  form, 
so  that  they  may  be  Invoked  by  special  routines,  more  efficient 
than  the  general  deductive  mechanism.)  This  will  regularize 
the  representation  of  rules  and  reduce,  by  a large  factor,  the 
number  which  have  to  be  stored. 


(2)  Using  the  tautologies; 

a^avb 

end  AABmefA 

rules  which  arc  obviously  redundant  will  be  (at  least  temporarily) 
rcBK>ved.  For  example,  in  each  of  the  following  eases  the  rule 
on  the  right  is  derivable  from  the  rule  on  the  left  and  can 
be  removed  with  no  loss  in  the  deductive  power  of  the  system 

Aa^B  AACafB 

Ai^B  Am^B  V C 

(That  is,  any  expansion  in  the  set  of  antecedents  or  conse- 
quents in  a rule  is  redundant.) 

(3)  The  following  pair  of  rules  are  inconsistent 

Atii^C  A-^-iC 

(4)  For  certain  restricted  sets  of  rules  (to  be  defined  as  part 
of  this  task),  before  each  rule  is  admitted  to  the  set,  an 
attempt  can  be  made  to  derive  the  rule,  and  than  its 
negation.  Failure  of  these  attenpts  will  be  indicative  of 
the  consistency  and  deductive  independence  of  the  rule 
relative  to  other  members  of  the  set. 

(5)  Finally,  an  additional  indication  of  rule  eat  consistency 

can  be  obtained  at  those  tines  when  new  facts  are  successfully 
derived  using  the  general  Inference  mechanisn.  If,  following 
successful  derivation  of  a fact  an  attesvt  at  deriving  its 
negation  fails,  then  this  can  be  taken  as  a partul  indication 
of  data  base  coneistency. 
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SECTION  III.  CREDIBILITY  AMALYSIS 

Data  in  an  Intalllganca  contaxt  raflacta  cha  analyata  viaw  of  the 
raal  world  atatc-of-affalra  aa  darivad  from  raporta  and  obaarvationa.  Aa 
auch,  aach  Itam  la  not  known  with  abaolutv«  cartainty  but  may  hava  aaaociated 
with  it  ona  or  mora  cradlblllty  maaauraa.  Thaaa  cradlbllity  factora  ara  da- 
rivad or  aatiaatad  by  tha  analyat  from  tha  raliablllty  of  tha  aourca,  tha 
accuracy  of  tha  obaarvation,  the  "age”  of  tha  data,  degree  of  independent 
varlflcatlon,  or  other  Inputa  and  ralatlonahlpa.  Wa  view  credibility  aa  a 
probability  of  truth,  or  aubjactlva  probability,  ona  of  tha  aavaral  valid 
Intarpratationa  of  probability,  and  therefore,  view  probability  theory  and 
inductive  logic  aa  part  of  the  thaoyatlcal  foundationa  of  tha  analvaia  of  the 
credibility  of  explicit  and  inferred  inforaatlon  in  an  intalllganca  ayatem. 

3.1  MATHEMATICAL  FOOIIMTIONS 


The  problam  bagina  with  tha  gmaation  of  cha  eradibility  of  aoM  con- 
Jaetura,  "fact",  or  bypotbaaia  poaad  by  tha  analyat  or  darivad  from  a raport 
or  tha  data  baaa.  Wa  uaa  claasleal  probability  tbaory  aa  the  Batbamatical 
foundation  for  Cha  analyala  of  chia  guaacion.  For  alapllclty  wa  will  call 
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•ach  relational  atatement  in  the  IntelUt.  ance  data  base  a fact  even  though  It 
Is  associated  with  a credibility  or  truth  probability.  A fact  then  is  a simple 
(atomic)  relational  statement  in  the  form  Rab  which  contains  only  Individual 
constants  (no  uninstantiated  variables).  We  contrast  this  with  rules,  which 
are  universally  quantified  statements  such  as  (Vx)  Rax  or  (Vxyz)  Rxy  A Pzy 
Rxz.  We  will  also  have  occasion  to  talk  of  queries  or  interrogations  which 
are  written  as  existentially  quantified  statements  (3x)  Rex  and  are  interpreted 
as  "determine  whether  or  not  there  are  one  or  more  instances  (x^)  of  x such 
that  Rax^  is  a fact".  As  in  the  case  of  facts,  rules  are  simply  plausible 
statements  which  are  associated  with  one  or  more  credibility  measures  interpreted 
as  measures  of  probability  of  truth  or  validity.  Thus,  we  will  talk  of  explicit 
facts,  which  are  derived  directly  from  observations  and  reports  and  exist  in 
the  data  base,  and  implicit  facts,  which  are  derivable  from  explicit  facts  using 
rules  and  derivation  procedures.  Our  main  objective  is  to  develop  a workable 
model  for  assigning  credibilities  to  simple  and  compound  statements  given  an 
initial  set  of  facts  and  rules  (and  their  credibilities)  and  to  determine  under 
what  conditions  this  is  or  is  not  possible. 

3.1.1  Scope  of  the  Credibility  Mathematical  Foundation 

It  is  desired  that  our  model  be  extendable  to  those  facts  that  assign 
a numeric  value  or  estimate  to  some  attribute,  such  as  a missile  range  capability. 
A traditional  structure  for  information  uncertainty  is  suggested  for  these  facts, 
making  use  of  statistical  concepts,  such  as  confidence  intervals. 

An  adequate  theory  or  mathematical  isodel  must  be  able  to  relate  the 
credibility  of  a fact  to  its  a-priori  probability  and  the  reliability  of  the 
observer,  and  observation,  and  report  from  whence  that  fact  is  derived.  An  ade- 
quate theory  snuit  also  account  for  the  credibility  of  a fact  derived  from  other 
facts  and  general  stateMnts  of  stated  plausibility  (rules)  using  stated  deriva- 
tion procedures.  One  prominent  reason  for  the  selection  of  classical  probability 
theory  as  the  mathematical  model  for  credibility  is  that  these  two  transitions  are 
best  known  and  naturally  axpreseed  in  the  language  of  subjective  (truth)  prob- 
ability. 
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3.1.2  Significanc*  of  th«  S«l«ctlon  of  Clagslcal  Truth  Probability 

for  tha  Fact  CTadlbllity 

Within  tha  abova  daacribad  acope,  the  chief  alternatives  to  the  mathe- 
aatical  aodal  aalactad  ware  the  use  of  elanenta  of  fuzzy  logic  instead  of  truth 
probability,  and  tha  uaa  of  a general  truth  value  rather  than  a truth  probability 
aatiMta.  Puaay  logic  is  defined  ao  that  for  two  statements  p and  q,  the  com- 
pound atateaent  **p  aad  q"  is  assigned  a truth  value  which  is  the  minimum  truth 
value  among  the  two  separate  statements  p.q.  In  addition,  the  truth  value  is 
sometimes  thought  of  as  merely  a helpful  general  indicator  with  no  attempt  to 
connect  with  the  truth  probability  of  a particular  fact.  We  note  here  that 
we  use  the  word  "fact",  in  this  document,  without  the  conventional  association 
with  complete  certainty. 

Attractiva  features  of  these  alternatives  include: 

(1)  Simplicity  of  the  minimum  rule. 

(2)  There  is  no  need  for  the  conditional  probabilities 
which  are  apt  to  be  unavailable  in  practice, 

(3)  The  difficulties  of  estimating  probabilities  are 
circumvented . 

Viewed  in  this  manner,  the  minimum  rule  is  fully  equivalent  to  an  ex- 
treme condition  among  the  (kno%m  or  unknown)  possible  conditional  probabilities, 
namely  that  which  assigns  the  highest  conceivable  value  to  the  probability  of 
the  cooq>ound  fact  "p  and  q".  Such  axtreme  assumptions  have  a strong  bias  towards 
overestimating  the  truth  of  compound  facts  and  of  any  facts  derived  from  such 
coaipound  facts,  using  inference  rules. 

In  the  case  of  a probabilistic  model,  the  credibility  of  the  compound 
statement  p and  q would  be  given  by  the  product  of  the  credibilities  of  the 
individual  statements  i.e.,  the  credibility  of  p times  the  credibility  of  q. 

This  is  tantamount  to  assuming  that  the  statements  p and  q are  independent, 
which  tends  to  be  the  most  reasonable  assumption  givan  the  absence  of  any  infor- 
mation to  the  contrary  (see  i^pendlx  C). 
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The  ••tlaatlon  of  fact  truth  probabilities  aay  be  a significant  in- 
tellectual task,  but  it  appears  to  lead  to  a better  intelligence  analysis  tool 
than  an  arbitrary  assignment  of  truth  values.  Much  of  the  value  of  a formal- 
ized or  mechanized  credibility  and  consistency  model  capability  lies  in  the 
comparisons  between  variously  related  facts,  and  the  truth  probability  esti- 
utes  provide  a unifying  theme  to  make  such  comparisons  meaningful.  In  addi- 
tion, as  already  mentioned,  this  unifying  theme  enables  the  transition  steps 
between  the  credibility  knowledge  of  reports  and  of  facts  derived  from  reports, 
and  also  between  the  credibility  knowledge  of  explicit  system  facts  and  of 
facts  derived  using  inference  rules. 

3.1.3  Treatment  of  the  Fact  Credibility  Foundations 

In  the  paragraphs  which  follow  the  method  of  employing  truth  prob- 
ability estimates  is  described  and  Illustrated  with  both  examples  and  Venn 
Diagrams.  Probability  is  represented  graphically  by  area,  and  area  overlap 

furnishes  the  Interpretation  for  conditonal  probability,  providing  a concrete 

* 

visualization  of  our  credibility  model. 

In  Appendix  B we  furnish  a graphical  interpretation  of  our  credi- 
bility method  designed  to  illustrate  the  significance  of  our  choice  of  classi- 
cal truth  probability  as  compared  with  other  choices.  The  work  assumes  the 
use  of  truth  probabilities  for  two  elementary  facts,  as  plotted  in  two  coordi- 
nates, the  third  coordinate  giving  probability  for  a compound  fact  based  on  the 
two  elementary  facts,  either  by  simple  conjunction  (the  "and"  combination  men- 
tioned above)  or  other  logical  combinations,  appearing  in  different  figures. 

The  result  is  generally  a solid  three  dimensional  plot  corresponding  to  the 
scope  of  possible  conditional  probabilities  between  the  two  elementary  facts. 

This  method  illustrates,  for  example,  how  the  minimum  of  the  two 
truth  values  (from  fuzzy  logic),  and  other  procedu’res,  all  are  consistent 
with  classical  logic  when  the  facts  arc  known  as  certsin.  It  further  illus- 
trates how  our  probability  product  method  gives  a result  near  the  centroid  of 
the  solid  truth  plot,  while  the  minimum  truth  value  approach  gives  an  axtreme 
at  the  solid  surface. 


CREDIBILITY  OF  INDIVIDUAL  FACTS  AND  RULES 


Initially,  wc  dascrlbe  the  uac  of  probability  cstiaatca  as  they  re- 
late to  credibility  of  ordinary  (explicit)  facts  in  the  data  base.  We  then 
expand  this  application  in  two  directions.  ‘The  first  includes  a sisd.lar  cred' 
'ibillty  aethod  for  facts  which  are  derived  from  ordinary  facts  asking  use  of 
fact  derivation  rules.  The  second  direction  shows  how  the  ordinary  fact 
credibility  estiaates  are  to  be  obtained  from  the  relevant  reports  which  are 
the  Inforaation  sources,  to  the  system. 


In  conputing  the  credibility  of  a derived  fact,  contributions  from 
both  the  rule,  and  the  hypothesis  facts  arc  used. 


In  deriving  fact  credibilities  from  report  credibility  we  introduce 
likelihood  numbers,  which  are  related  to  credibilities.  This  provides  a 
practical  way  of  updating  fact  credibility  when  a new  relevant  report  enters 
the  system.  This  is  conditioned,  of  course,  by  the  cos^ctcncc  employed  in 
making  the  report  likelihood  estimates. 


(Here  the  emphasis  is  upon  facts  which  fit  in  well  with  the  idea 
of  an  estimated  truth  probability.  This  excludes  facts  which  essentially 
assign  numeric  values.  The  method  suggested  for  such  facts  is  the  use  of 
an  assigned  best  estimate  with  interval,  to  be  updated  using  ordinary  statls 
tlcal  methods. 


Individual  Fact  Probabilit 


Here  we  describe  the  use  of  ordinary  probability  estimates  as  associat- 
ed with  those  system  facts  where  it  makes  practical  sense  to  designate  the  chance 
that  a system  fact  is  actually  true.  In  this  discussion,  we  make  liberal  use 
of  examples  and  a graphical  presentation  of  such  facts,  with  areas  representing 
the  truth  probability  estiaates.  In  i^pendix  B,  Theoretical  Foundations,  a 
different  graphical  technique  is  employed.  There  the  purpose  is  to  demonstrate 
the  connections  with  the  procedures  idien  the  practice  is  to  assume  complete 
certainty  in  system  information. 
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In  practice,  it  la  natural  and  profitable  to  be  influenced  by  the 
whole  pattern  of  associated  facts  in  estlntating  the  truth  probability  of  any 
one  given  system  fact.  This  larger  viewpoint  is  discussed  in  Section  IV, 
Consistency  Analysis.  Here  we  are  concerned  with  Individual  non-isolated 
facts  taken  together  in  simple  cosd>lnatlons. 

$ 

An  example  of  such  a concern  is  the  question  of  the  estimate  that 
both  of  two  facts  are  simultaneously  true,  when  there  are  already  similar  es- 
tljsates  for  each  of  the  two  facts  separately.  Such  problems  are  also  in  the 
later  discussion  dealing  with  the  derivation  of  facts  from  rules. 

3. 2. 1.1  Relationships  Between  Two  Individual  Facts 

We  assume  that  individual  facts  may  in  each  case  be  associated 
with  a number , ranging  from  0 to  1 , which  represents  an  estimate  of  the  prob- 
ability that  the  fact  is  true.  We  use  fact  in  the  sense  of  statement,  meaning 
that  it  is  not  necessarily  true,  contrary  to  general  usage.  Such  statements 
form  the  bulk  of  the  data  of  the  system,  examples  of  which  follow: 

.9,  DA  (1,  2)  System  1 was  developed  at  facility  2 

.8,  WU  (2,  7)  Person  2 works  with  person  7 

1.0,  WA  (4,  3)  Person  4 jEorks  gt  facility  3 

An  interpretation  of  these  statements  can  be  made  using  traditional 
Venn  diagrams,  but  with  areas  proportional  to  probability.  Thus,  a diagram 
of  the  first  two  statements  may  appear  thus: 

DA  (1,  2) 
f- WW  (2,  7) 
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It  Mj  help  CO  laagln*  a dart  board  in  which  the  dart  is  aqually  liabl*  to  land 
at  any  spot  in  the  imlvarsc  U . The  oval  DA  (1,  2)  represents  the  fact,  the 
dart  Inside  DA  (1,  2)  represents  truth,  and  the  dart  outside  represents  falsehood 
the  areas  being  in  the  proper  proportions.  The  stanner  of  drawing  the  above 
figure  mmmiB  that  given  HW  (2,  7)  is  true,  then  surely  DA  (1,  2)  is  true.  In 
logic  notation  this  is  WW  (2,  7)>i^DA  (1,  2).  It  was  not  necessary,  however,  to 
represent  the  two  facts  in  that  aanner. 


Another  presentation  of  the  aaae  two  facts  is  as  follows 


Where  we  have  moved  the  UW  (2,  7)  oval  so  as  to  einbraee  the  upper  80  percent 
of  the  Universe  U • Under  this  diagram  it  is  no  longar  true  that 
WW  (2,  7)^DA  (1,  2).  That  is  to  say,  if  the  dart  should  land  inside  WW  (2,  7) 
it  may  or  awy  not  land  inside  DA  (1,  2).  More  specifically,  there  is  an  approxi 
nately  7 or  8 percent  chance  that  the  dart  might  land  in  chat  upper  portion  of 
the  area  corresponding  to  DA  (1,  2)  being  false.  We  sec  that  there  is  another 
property  of  our  statesMnt  above  and  beyond  the  probability  and  the  identify  of 
the  facts,  namely  relationships  batween  the  facts. 


Further  axamples  to  illustrate  relationships  between  facts  follow 
in  thrae  pairs;  with  truth  probabilities: 


Scientist  3 works  in  Pittsburgh 
Scientist  3 works  in  Pennsylvania 
Scientist  2 works  in  Philadelphia 
Sciantist  2 works  la  Pittsburgh 
Scientist  A works  in  Albany 
Scientist  4 is  male 


I 


V*  notice  that  the  Venn  dlegrem  repreeentatione  are  not  chosen  capriciously, 
but  represent  soewthing  inherent  in  the  nature  of  the  facts.  Even  though  there 
is  wcerteinty  about  the  A^,  A2  facts,  it  is  surely  true  that  A^  being  true 
argues  that  A2  is  true,  a siatter  of  geography.  Zn  logical  language  we  have 
A^-^  A^  necessarily  true.  In  probability  language  we  have  <A^^  A2>  • 1.*  We 

use  tht  angle  brackets  to  denote  probability  and  the  single  arrow  to  denote  the 
from  - to  relationship  of  conditional  probability.  We  tabulate  the  general  re- 
sults thus,  using  *1  to  Man  negation: 


A pair 

B pair 

C pair 

Logic  Language 

A2-^A2 

»1=^*’»2 

mga 

*>A2=^nAj 

*2^  -.Bi 

BEB 

BQ 

Probability 

Language 

<Aj  A2>  " 1 

<Bi  B2>  ■ 0 

<C2  -►  C2>  ■ 

■ <C2> 

<tA2  ■ 1 

<^2  Bj>  - C 

<C2  -*•  Ci>  ■ 

' <Ci> 

It  is  particularly  interesting  to  note  the  C pair  of  statenents, 
which  spproxlsute  a condition  of  probabilistic  independence.  This  means  , in 
dart  language,  that  knowledge  that  the  dart  lands  inside  the  oval  does  not 
lead  to  any  expectation  that  the  dart  is  inside  or  outside  the  C2  oval,  except- 
ing such  expectation  as  already  existed.  The  same  thought  Mans  that  C2 

andnC^*^  C2  are  equally  likely.  In  the  figure,  the  probability  of  failure 
of  either  implication  is  represented  by  the  12-1/2  percent  portion  of  the  total 


j * Prob(A^|A2>  is  represented  as  <A2-*^  A.>  In  the  notation  adopted  here. 


•rM  at  on*  right  aid*  eomor.  In  nor*  traditional  probability  languaga, 
th*  probability  of  tb*  atatanant  C2  ia  not  affaetad  by  th*  aaaaaption: 

<C^C2>  ■ <C2>»  iB  thia  caa*  «*  aay  C2  and  art  indapandant.  In  popular 
languaga,  wa  could  eharactoriaa  tha  A pair  aa  baing  aupportiva  atataaanta,  tha 
B pair  a*  baing  antagoniatic,  and  th*  C pair  a*  baing  impartial,  or  indapandant. 
Baeaua*  «*  hav*  in  mind  a ayatam  condition  where  conditional  probabilitiaa  nay 
b*  fraquantly  wiloiown,  the  aaaumption  of  indapandanc*  ia  th*  moat  attractive 
aa  compared  with  th*  other  awr*  extrema  poaaibilitiaa.  Much  of  th*  aubatanc* 
of  th*  following  pagaa  ia  an  attempt  to  incorporate  in  logical  inferanc*  pro- 
caaaaa  auch  infonaation  aa  may  b*  available  concaming  tb*  relation*  between 
diffarant  atatamanta , which  conatitut*  th*  data. 

3. 2. 1.2  Tha  Coagrahanaiva  Kola  of  Conditional  Probability 


If  w*  not*  th*  poaaibilitiaa  of  aimpl*  conjunction*  and  di* junction* , 
with  aaaociatad  probabilitiaa,  for  each  of  th*  above  pair*  of  atatamanta,  w*  gat 
th*  following  table: 


A pair 

B pair 

C pair 

Conjunction 

Logic 

A A2  * Aj 

Bj^A  B2  empty 

®2 

Probability 

<Aj  A A^  - <Aj> 

<Bj  A B^  - 0 

A 

> 

C2>  - <Cj>  <C2> 

Dia  junction 
Logic 

Ai  V A2  - A2 

B1VB2 

S 

Probability 

<Ai  V A^  - <A2> 

<Bj  V B2>  • 

<0^  V 

C2>. 

<Bj>  + <B2> 

1 - 

(1-  <C2»(1-  <C2» 

W*  notiea  her*  a tandancy  for  th*  aaauaqption  of  probabiliatic  indapandanc*  to 
h*  midway  hatwaan  th*  other  more  axtram*  poaaibilitiaa,  lAieh  w*  hav*  already 
noted  ahova,  and  uhieh  ramaina  true  for  more  elahorat*  logiaal  axpraaaiona.  A 
▼lawpoint  which  ambracaa  all  three  condition*  i*  th*  following: 

<P  A <J>  • • <P  Q> 
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Th*  value  of  the  conditional  probability  determines  whether  the  facts  P,  Q 
arc  related  as  pair  A,  B,  or  C above,  or  perhaps  in  an  Intermediate  manner 
tabulate  the  results: 


We 


<Q/^  Value 

Results 

1 

<p  A Q>  ■ <^,  as  with  A pair 

0 

<P  A Q>  ■ 0 , as  with  B pair 

<Q> 

<P  A Q>  ■ <F>  <Q>,  as  with  C pair 

It  Is  from  this  sK>re  general  viewpoint  that  the  remainder  of  this  description 
of  use  of  probability  with  data  and  rules  is  written. 

3. 2. 1.3  The  Practical  Advantaae  of  the  Product  Buie 

We  note,  partly  because  of  previous  effort  in  this  direction,  that 
the  work  above,  for  pair  A2,  in  general,  yields  the  results: 

<AjA  Aj>  ■ min  {Aj,  A^) 

<Aj  w A^  - max  {A^  , A^) 

In  the  above  pages,  for  reasons  of  clarity,  <A^>  was  selected  as  less  than 
in  agreement  with  the  Venn  diagram.  But  we  note  that  these  formulas  are  a 
specialisation  of  the  general  conditional  probability  formula  as  discussed 
above,  and  this  appears  to  be  the  source  of  their  validity  and  usefulness  in  e 
probability  framework.  A direct  application  of  the  min-max  formulas  to  general 
stateaMnts  has  more  difficulty  than  serious  inaccuracy  where  the  statements 
do  not  have  the  properties  assumed,  as  the  A pair  do.  There  is  a failure  in 
being  well  defined,  even  for  compound  statements  of  only  modest  cnsplexity. 

An  example  follows: 

(1)  <PA'nB>  - min  (<P>,  <-i 

• 1/2  in  case  <1^  • <1^  • 1/2 


<2)  <P  P>  • <aaipty  statomaai>  • <0>  ■ 0 
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Bar*,  P and  'nr  elaarlp  h«v*  a ralatlonahip  aueh  as  pair  B abova,  and  «*  hai-s 
usad  th*  Inapplieabl*  fonulas  approprlat*  to  pair  A.  Th*  raaults  ahow  that 
Inaeeurat*  aolutlona  nay  ba  darlvad  and  that  th*  aolutlona  dapand  upon  th* 
fon  of  th*  coapound  atataaant.  Thas*  dlfflcultlaa  do  not  appaar  to  plagu* 
work  don*  fron  th*  ganaral  probability  viawpolnt.  Us*  of  tha  product  rul*  la 
just  anothar  spaclal  rul*  and  can  land  to  thaaa  dlfflcultlaa  la  tha  saaa  way 
that  us*  of  th*  rlrmn  rul*  can.  Howavar,  th*  Inaecuraelas  and  dlfflcultlaa 
of  using  th*  product  rul*  (in  cas*  tha  condltonal  probabUltlas  ar*  not  avail- 
abla)  tand  to  b*  lass  than  using  a apaclal  rula  for  a aora  axtraa*  casa,  such 
as  data  pair  A or  B abova.  Appllad  to  th*  abova  slapl*  easa,  w*  lllustrat* 
«»  ■ <-i^  ■ 1/2  easa): 


nln-aMK  fomula 

product  fomula 

ganaral  fomula 

<PA-V  ^ 

<PA-»I> 

<FA“i  ^ ■ <D>  ■ 0 

■ nln  (<^, 

• <P>  <“1^ 

or  • <f>  <nP/^ 

- 1/2 

- 1/4 

• (0)  »0 

H*  hop*  than  that  «*  will  b*  abla  to  us*  conditional  probability  whan  It  la 
■oat  halpful,  or  at  laaat  whan  It  la  avalldbl*.  If  It  la  not  avallabla, 
though,  w*  plan  th*  us*  of  th*  baat  spacUl  rul*.  naaaly  th*  product  rula,  for 
data  that  la  Indapandant  In  It's  probabilistic  natur*. 

3.2.2  Darlvatlon  of  Facta  fron  Rulaa 

Th*  aluplar  feta*  of  rulaa  which  produc*  facts  darlvad  free  th*  basic 
ayataa  facts  ar*  daaerlbad.  Thaaa  rulaa  hav*  th*  structura  of  an  ordinary  log- 
ical laplleatlon  giving  a slngla  darlvad  fact  as  tha  rasult  (or  coasaguaat)  of 
an  assta^tlon  baaad  upon  th*  truth  of  on*  or  nor*  facts  In  th*  rul*  bypothaala. 

Bo  eonsldaratlon  is  glvun  to  tha  breadar  class  of  rulaa  iBach  nay  provld*  aanantlc 
daflnltlon,  or  halp  laplansnt  ayataa  Infomstlon  structura. 

Th*  nathed  of  aaanpl*  and  graphical  Illustration  la  usad  to  asplaln 
a taehnlqua  for  laeludlng  In  th*  darlvud  fact  eradlbUlty  aaclaat*  an  approprlat* 
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accounting  for  the  intrinaic  •uncertainties  of  the  rule  itself,  as  distinct  from 
the  uncertainties  of  the  facts  in  the  rule  hypothesis.  The  focal  point  of  in- 
terest is  the  credibility  of  the  derived  fact  Itself,  rather  than  the  related 
concept  of  the  truth  probability  of  the  logical  implication. 

This  method  is  pursued  to  the  point  of  including  rules  whose  hypoth- 
esis facts  are  probabilistically  independent.  This  is  characteristic  of  the 
rule  exasples  thus  far  examined,  and  may  suffice  for  STIS  requirements  for  the 
near  future.  If  the  rule  hypothesis  facts  are  not  probabilistically  independent, 
then  the  use  of  the  traditional  probability  product  rule  is  still  the  best  pro- 
cedure in  case  the  appropriate  conditional  probabilities  are  unknown.  This  is 
a chief  result  of  the  Investigation  of  Appendix  B.  and  of  the  illustrations  of 
paragraph  3.2.1. 

Another  such  result  is  that,  in  the  event  the  appropriate  conditional 
probabilities  are  known,  then  the  use  of  then  makes  a very  substantial  improve- 
ment in  the  derived  fact  credibility  estimate.  A method  for  so  doing  is  ex- 
plained in  Appendix  B. 

3. 2.2.1  Problem  Definition  for  a Derived  Fact  Probability 

An  exaaiplc  of  a rule  follows! 

UA  (2,  4)  A WW  (1,  2)«^WA  (1,  4)  ("instantiated”  form) 

VA  (x,  y)A  WW  (e,  x)  w^UA  (a,  y)  (general  form) 

Using  language  as  at  the  start  of  the  paper,  this  rule  helps  provide  informs- 
tion  about  where  parson  #1  works  on  the  basis  of  knowledge  of  where  co-worker 
paraea  #2  works*  If  the  atatanent  WA  (1,4)  la  in  the  data  baae,  then  the  rule 
may  not  have  to  be  used,  aapaelally  if  the  probability  astlmate  is  high  such  as: 

0.98,  UA  (1,  4) 
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Th«  •Btlaation  of  the  probability  of  tht  rasult  or  consaquent  of 
Btich  an  iaplication  is  tha  cantral  probalaa  still  raaaining  hara.  Tha  infer- 
anca  procass  consists  of  answaring  a givan  quary  by  conbinations  of  saarchlng 
tha  data  stataaants  diractly,  and  using  rulas  to  gat  darivad  data.  The  dis- 
cuasion  above  has  described  a way  of  treating  uncertainty  in  tha  original  data. 
Mow  a aiailar,  but  aora  involved  aathod,  is  naadad  for  darivad  data  probability. 

Wa  auppoaa,  first,  a siaipla  single  literal  hypothesis  in  an  implica- 
tion rule  p^  q.  Wa  regard  this  as  eonplatsly  equivalent  to  tha  statement 
-I  p V q.  (htr  ultiSMta  eoneam  is  not  with  tha  probability  of  the  implication 
Mot  with  tha  probability  of  the  consequent  <q>. 

3.2. 2. 2 Tha  Use  of  Conditional  Probabilities  for  a Oarivad  Fact 

In  approaching  this  goal,  wa  define  two  masbars.  Tha  probability 
that  tha  consequent  is  true  if  tha  antacadant  is  true  is  Just  tha  conditionsl 
probability  <p^^.  Tha  probability  that  tha  consaquent  is  true  if  tha 
antacadant  is  falsa  is  tha  conditional  probability  <np^^. 

Ue  tharafora  adopt  tha  notation: 

« “ip-^  q>.  < p*^q>)  p^q 

ananpla: 

(.2,  .f)  p^q 

signifias  that  <p^  ^ • *f 

■ ,2 

Another  ananpla  follows: 

(0,  1.0)  p^  q 

This  is  the  ease  lAan  the  inplieaticn  p^  q is  alwsys  true  (aenpara  with  data 
pair  A diaenssad  in  paragraph  3. 2. 1.1). 
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3. 2. 2. 3 First  E»tla«te  of  the  Credibility  of  a Derived  Fact 


V«  alto  nott  that  the  Interpretation  of  the  first  of  these  rule 
probabilities  can  be  given  In  various  ways,  and  the  ways  are  equivalent. 

Using  tha  example  (.2,  .9)  P — ^ q, 

<pa^q>  ■ ,9  when  <p>  - 1 

<q>  ■ .9  when  <p>  • 1 

<p-^q^  • .9  whan  <p>  ■ 1 

Hare  we  use  tha  single  arrow  p q as  the  event  q when  p Is  given  true. 

It  la  easy  to  see  that,  using  <p>  ■ 1: 

<p  -►  q>  • <-^  V q>  • < OV  q>  ■ <q>  and  <p  q>  ■ <q> . 

Whichever  of  the  three  interpretations  we  regard  as  fundamental,  it  re- 
mains true  that  bur  probability  number  (a.g. , .9  above)  is  an  estimate  of  the 
Intrinsic  rule  ancertalnty  present  when  the  hypothesis  or  the  input  Is  per- 
fectly certain.  Therefore,  an  estlMte  of  the  consequent  probability 
is  given  thus: 

estimate  <t^  - (.9)<ij> 

We  mote  thht  this  can  be  regarded  as  a sort  of  machine  operation,  the  rule  being 
tha  machine,  which  cannot  possibly  have  an  output  (consequent  probability)  of 
better  quality  than  the  input  (antecedent  probability).  Thus,  our  .9  number 
is  a unique  estimate  for  the  intrinsic  uonfldence  quality  of  the  rule  itself, 
which  normally  applies  to  a considerable  number  of  possible  facts  or  literals. 
This  is  illustrated  by  our  early  rule  essmble: 

WA  (X,  y)A  WW  (a,  x)^WA  (a,  y) 

Where  x,  y,  e may  represent  many  possibilities  of  workers  and  facilities  and  a 
wide  range  of  prebabillties  for  the  date  itself.  However,  this  <q>  estimate 
thus  far  computed  is  not  eomplate. 


Improved  Esf*— f of  the  Credibility  of  a Derived  Fact 

Th«  aitsing  portion  pf  the  •stimatc  thus  far  hat  to  do  with  the 
poaalbillty  that  tha  conaaquant  nay  be  true  oeeaalonally  in  apita  of  the 
hypothaaia,  that  ia  whan  tha  hypothaaia  ia  falae.  Notiea  wa  are  not  conaidaring 
tha  probability  of  tha  implication  rula  baing  true,  <p  q>  ■ <-tp  Vq>,  but 
rathar  tha  ganarally  diffarant  probability  of  the  conaequent  being  true,  <q>. 

For  axampla,  a particular  caae  of  the  above  rule  might  be: 

I 

I UA  (2,  4)A  WW  (1,  2)^WA  (1,  4) 

It  might  happen  that  the  hypothaaia  hare  ia  falaa,  e.g.,  bacauaa  it  ia  Vmown 
that  paraon  1 doea  not  work  with  peram  2.  However,  it  may  be  true  that  paraon 
1 worka  at  facility  4,  even  though  thia  ia  not  by  the  power  of  the  implication. 
If  there  ware  10  facilitiaa,  than  we  might  eatlmata  there  iava  10  percent 
chance  that  HA  (1,  4)  ia  true  even  though  the  hypothaaia  ia  definitely  falaa. 
Thia  la  tha  part  played  by  the  .2  in  the  following  axampla: 

(.2,  .9)  p^q 

Tharafora  tha  final  eatlmata  of  ia  given  by: 

<<j>  ■ (.9)  <p>  + (.2)(<-i  p>) 

- (.9)  <p>  + (.2)(1  - <iO) 

• .2  + (.7)  <i> 

It  mMy  be  argued  that  thia  raflnanent  nay  not  be  worth  incorporating, 
alnca  it  involvaa  an  estimate  outaida  of  tha  usual  purpose  of  the  implication 
rule.  It  nay  be  further  argued  that,  if  tha  hypothaaia  is  not  satisfied, 
tha  ntatbar  giving  tha  probability  of  tha  consequent  will  be  likely  close  to  zero. 
Thus,  it  nay  aaan  that  tha  difference,  e.g.,  between: 

•1,  q and  0,  q 

nay  seen  of  inpractical  aiptificanca.  But  tha  ravaraa  view  of  tha  natter  nay 
conceivably  ba  nislaading  or  dangerous.  Consider  for  axaaq>la,  tha  result: 
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l.O,“lWA  (I,  4)  •qulvalcnt  to  0,  WA  (I,  4) 


which  «ays  that  person  1 daflnltaly  does  not  work  at  facility  4,  this  answer 
la  clearly  poor  if  the  only  basis  is  the  knowledge  that  the  hypothesis  VA  (2,  4) 
A nu  (1,  2)  is  false. 

3. 2. 2.5  Graphical  Presentation  of  Derived  Fact  Method 

t 

4 ¥enn  diagram  picture  of  our  siaiple  hypothesis  rule: 

(.2,  .9)  p«^q 
would  appear  as  follows: 


where  we  have  shaded  that  portion  of  the  <q>  estimate  associated  with  the 
p q>  rule  probability  number.  If  the  q boundary  were  to  coincide 
with  the  p vertical  boundary,  then  the  classical  p-^q  implication  would  be 
represented  for  the  ease  that  the  implication  never  fails.  If  we  use  both  our 
implication  probability  numbers  (.9  and  .2),  then  we  have  represented  <q> 
accurately  in  the  diagram  abova,  given  both  shaded  and  unshaded  <qp>  area.  If 
we  permit  the  refining  conditional  probability  number  to  be  entered  as  zero, 

then  the  shaded  portion  of  the  <q>  area  (if  there  is  any)  has  been  overlooked. 
The  unshaded  portion  of  the  <q>  area  is  that  which  the  first  probability  nu^^ber 
(.9)  accounts'^for  by  itself. 
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3. 2. 2. 6 Facts  Dtrlvd  From  CoBtpound  Hypotheses 


Ideas  and  estimates  can  be  readily  developed  for  implication  rules 
with  a compound  hypothesis,  such  as: 

pA  q^r 

If  VC  arc  sure  of  the  probability  of  the  hypothesis,  <p  A q>,  then  the  work  of 
the  precceding  pages  may  be  applied  by  the  simple  device  of  treating  pA  q as  if 
It  were  a single  fact  hypothesis.  A much  more  likely  situation  Is  that  we 
may  have  an  astinata  of  the  probability  <{£>  and  the  probability  <q>  and  wish  to 
astinata  <e>*  If  nothing  alsa  is  known,  then  <p  A q>  nay  be  estimated  as 
<p>  the  degree  of  error  in  such  an  estimate  depending  upon  the  extent  to 
which  p and  q really  are  independent.  We  expect  the  information  that  p and  q 
are  not  probabilistically  Independent  to  appear  in  the  system  in  another  form 
such  as: 

P*  q 

or  perhaps  with  probability  nuaibers  as  previously  discussed,  e.g.: 

(.15,  .9)  p^q 

One  issue  to  discuss  is  how  this  relationship  is  to  be  used  in  estimating 
<t>.  Another  issue  is  to  sec  Just  how  the  <r>  estimate  is  to  be  modified 
(as  mentioned  above)  in  the  event  that  p A q is  false.  This  last  issue  may 
be  broken  down  into  cases,  such  as  p alone  false,  q alone  false,  etc. 

3.2.3  Derivation  of  Facts  from  Keports 

In  many  cases  it  may  be  an  effective  practice  to  estimate  the  cred- 
ibility, or  truth  probability  estimate,  of  a systam  fact  directly.  In  those 
instances  where  an  occasional  report  or  a changing  backgrotmd  condition  has 
sufficient  impact,  then  a fresh  direct  estimste  msy  be  made.  However,  iHien 
there  is  a more  or  lass  established  flow  of  relevant  reporta,  a more  syste- 
matic approach  is  likely  to  be  desirable. 


Depending  upon  the  type  of  the  system  fact,  two  different  procedures 
are  described  for  the  situation  of  an  established  flow  of  reports.  The  simp- 
ler case  is  that  where  the  system^ fact  establishes  some  numeric  estimate  for 
a technical  fact.  These  facts  contrast  with  the  relational  type  facts  under 
'discussion  in  recent  paragraphs.  It  also  appears  practical  to  represent  fact 
uncertainties  with  a best  estimate  and  Interval  structure.  The  more  subtle 
case  is  the  application  of  the  Bayes  Theorem  to  update  the  credibility  of  facts 
recently  discussed. 

The  numeric  estimate  type  fact  may  be  updated  for  each  report  by 
standard  statistical  methods.  This  type  fact  may  predominate  in  the  STIS  in- 
formation, but  the  method  of  updating  is  so  common  that  the  description  has 
been  kept  brief.  Depending  upon  particular  problem  features,  different  variants 
of  a weighted  updating  procedure  using  a current  best  estimate  and  a current 
interval  are  anticipated. 

Similar  updating  features  for  the  facts  with  credibility  involve  the 
use  of  Bayes'  Theorem  put  in  the  language  of  fact  likelihood  and  report 
likelihood.  These  likelihoods  are  probability  ratios  which  are  closely  linked 
with  credibility  concepts.  The  use  of  these  likelihoods  results  in  a practical 
directness  and  simplicity  of  method,  much  like  the  use  of  logarithms  in  certain 
computation  problems. 

The  use  of  Bayes*  Theorem  in  the  likelihood  form  involves  one  with 
important  operational  subtleties.  Questions  occur  involving  the  relative  chance 
that  a report  may  be  received  even  if  its  content  is  false,  and  involving  the 
extent  to  which  a report  duplicates  previous  reports  without  really  offering 
additional  support  to  the  fact  under  consideration.  Such  problems  should  be 
faced  in  any  event. 

Accordingly,  the  major  description  of  the  Bayes  technique  is  retained 
In  the  body  of  this  report.  With  a continued  use  of  examples,  certain  problems 
are  further  discussed  in  Appendix  C. 


] 
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3.2. 3.1  Survey  of  the  Problen 


He  consider  first  s Method  by  which  relstionsl  systcn  facts  (e.g., 
"B^loys",  ’’Works  st",  etc.)  are  built  up  from  the  basic  report  inforastion. 
Previous  notes  have  essuaed  facts  such  as; 

,75,  «k(2,7)  Person  #2  irorkd  at  facility  #7 
with  a probability  estinated  at 
.75 

and  have  treated  the  searching  and  combining  of  such  facts.  Here  a possible 
procedure  for  obtaining  and  updating  the  .75  credibility  estimate  is  examined. 
It  uses  the  grass  roots  information  of  the  reports  coming  into  the  system.  In 
greater  generality,  we  regard  the  above  exao^le  as  a special  case  of: 

<«>,  e 

where  the  event  e happens  to  be: 
e - HA(2,7) 

and  the  credibility  of  the  event  c is: 

<•>  ■ .75 

The  procedure  is  to  consider  the  application  of  Bayes*  Theorem  to 
the  reports  bearing  on  such  a fact  as  shown  above.  The  central  quantity  which 
each  such  new  report  brings  into  the  system  is  the  likelihood  or  probability 
ratio  1,  defined  as  follows: 

A (e  ^ R-)  - *e^,  where  R is  the  report  of  the  event  e 

which  appears  in  Bayes’  foraulatlon.  This  is  the  ratio  of  the  chances  of 
getting  the  report  if  the  fact  is  true,  divided  by  the  chances  of  getting  the 
import  if  the  fact  is  false.  This  estimate  is  asde  when  the  report  is  first 
for  establishing  a syotea  fact.  For  reports  of  high  sharpness  or 
dlaerlminatlon,  the  ratio  should  be  large. 
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This  l««d«  to  an  Intereiting  rastatcnent  of  Bayes'  Theorem, 
naking  uaa  of  a atmilar  concept  of  likelihood  ratio  for  the  facts  themselves, 
designated  thus: 


L(e) 


<£> 
< e > 


.From  this  viewpoint  a report  is  exactly  a likelihood  ratio  improver  for  the 
ayatem  facts.  The  restatamcnt  of  Bayes  Theorem  is: 

^new^*^  “ 

which  will  be  proven  in  paragraph  3. 2. 3. 4.  Therefore,  the  value  of  the  report 
R,  is  identified  with  the  report  likelihood  ratio,  in  the  sense  that  the  high 
ratio  values  mean  the  greater  increase  in  the  system  fact  likelihood. 

Finally,  a rather  different  sort  of  system  fact  is  considered,  as 
illustrated  by: 

Range  (17,llil)  Missile  site  #17  has  a range  capability  in  the 
10  to  12  mile  interval. 

Such  facts  have  a different  credibility  structure.  An  essentially  statisti- 
cal approach  is  Indicated  for  utilizing  firing  reports  to  update  such  a 
fact. 

3. 2.3. 2 Two  Reports,  Bayes  Theorem 

Suppose  we  start  with  two  reports  pertinent  to  the  fact  that  person 
#2  works  at  facility  #7.  In  this  simplified  example,  assume  the  reports  take 
the  form  Rj^  - [source  S^,  fact],  e.g. , 

Rj  - [Sj,WA(2,7)]  and 

Rj  - [Sj,WA(2,7)3. 

Suppose  further  that  the  analyst  treats  R^  alone  with  a credibility  of  .75, 
that  is,  <Rj^WA(2,7)>  ■ .75,  where  the  left  side  of  the  equation  is  the 
probability  that  the  content  of  the  R^  report  is  true  based  upon  taiowledae 
of  the  report,  and  that  report  alone.  He  also  suppose  that  the  analyst  treats 
R2  alone  with  a credibility  of  .80,  that  is  <R2*^HA(2,7)>  ■ .80,  where  the  left 
side  of  the  equation  is  the  probability  that  the  R^  report  is  true  without  any 
Inowledfe  of  the  R^  report.  If  we  assume  there  are  no  further  reports  bearing  on 
MA(2,7),  and  if  we  also  ignore  the  R^  report,  the  best  that  could  be  entered  in 
the  fact  file  of  the  systSB  would  be: 

.75.  HA(2,7) 
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This  face  would  then  be  • one  report  fact  of  the  sort  previously  analyzed  In 
a systea  with  facts  and  rules.  We  now  consider  som  possibilities  In  combin- 
ing reports  and  R2  to  get  a Joint  WA(2,7)  result  In  the  fact  file. 

I A very  inportant  consideration  in  such  a eoablnatlon  Is  the  degree 

to  which  the  two  reports  overlap.  If  It  should  happen  that  both  R^  and  R^  are 
reports,  by  different  observers,  that  person  #2  Is  listed  on  a facility  #7 
payroll  listing,  then  the  two  reports  are  almost  duplicates.  The  .80  cred- 
ibility rating  for  R2  nay  aerely  reflect  the  conditions  of  a more  reliable 

I observation.  The  process  of  combining  the  two  reports  might  well  approximate: 

I ,80,  WA(2,7) 

thus  indicating  that  report  R^  vas  essentially  subsumed  by  R2. 

A contrasting  possibility  is  that  R^  and  R2  nay  furnish  essentially 
independent( sources  Sj  and  $2  completely  distinct)  information  supporting  the 
fact  VA(2,7).  For  axaaq>le,  R^  may  be  assuawd  to  be  a payroll  observation,  as 
assumed  above.  But  R2  nl^t  be  an  observation  that  person  #2  was  seen  at 
facility  #7.  Since  the  reports  rest  on  a different  information  basis,  it 
appears  reasonable  to  expect  a stronger  supportive  effect. 

Me  attack  this  problem  by  considering  Bayes'  formulation  of  a pos- 
terior probability.  This  can  be  derived  as  follows: 

<D  A H>  ■ <D>  • <D  -*■  H>  • <H>’<H  -►  D> 


f 

f 
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fora: 


V*  apply  Bayas*  foraulacion  to  chit  two  raport  problaa  in  the 


<Rj-»  «A(2,7)> 


<MA(2,7)-»R^  <WA(2,7)> 

<WA(2,7)-»  Rj>  <WA<2,7)>  + 0».(2,7yrR^  <8A(2,7)> 


Wa  alao  neta  that  ^(A^,7)>  la  baaad  upon  Rj  above,  tliat  la  to  aay  WA(2,7)>  ■ 

<WA(2,7)>  ■ ,75  as  coBanentad  upon  above.  Thus,  ^2“^  WA(2,7)>  la  tha  iaiproved 
astinaie  of  O^A(2,7)>  bacauaa  of  the  assiatanca  of  the  latar  report  R^, 


An  Interesting  case  occurs  whan  the  R2  raport  la  laq>osslble  when  UA 
(2.7)  is  falsa: 


<0A(2,7)-r  Rj>  - 0 


This  naans,  of  course,  chat  the  R^  report  is  highly  reliable . Computation 
yields  top  probability  for  the  new  UA(2,7)  estimate: 


UA(2,7)>  - 1 


Thus,  va  sea  that  the  estimate  of  the  likelihood  ratio: 


l[wA(2,7)'^  R2] 


<WA(2,7)-»  R2> 
<OA(2,7)-t  Rj> 


is  central  to  an  ondarstanding  of  tha  raport  Rj  and  its  affect  on  tha  04A(2,7)> 
estimation.  However,  it  is  not  always  easy  to  sea  how  this  ratio  is  to  be 
estiMtad  in  a given  practical  situation,  particularly  if  the  report  foundation 
for  tha  old  <«A(2,7)>  estimate  is  not  known  or  understood.  To  illustrate  this 
possibility  wa  consider  tha  extreme  example  where  R^  and  R^  are  rcallv  the  same 
report  but  they  are  accepted  as  distinct  renorts  because  of  a clerical  or  tech- 
nical error.  It  would  be  desirable,  in  this  case,  to  have 

<HA(2,7)->R2> 

<HA(2,7)-PR^  “ ^ 

baeauaa  this  is  the  value  Which  results  in  tha  <UA(2,7)>  astimata  being  unchanged  by 
tha  introduction  of  the  radimdant  Rj  raport.  However,  tha  above  ratio  atatament 
inplias  that  tha  likelihood  of  getting  raport  R2  ia  completely  independent  of 


whethtr  Ul(2,7),  th«  hypothMis,  !■  tru*  or  falso.  Ihla  aounds  dlaturbint  «»tll 
ont  raflacts  that  a aora  aeeurata  asaaaaMnt  of  tha  ratio  atatoMnt  ia  that  tha 
duplication  of  report  9^  la  Indapandant  of  tha  truth  of  tha  Iqrpothaala.  This 
degraa  of  duplication  la,  of  eouraa,  an  laportant  natter  in  an  effective  dla» 
tilling  of  the  pa— r of  the  avldenee  fron  varloua  reporta.  In  aupport  of  one  of 
* the  ayatan  facta.  It  nay  requlra  a higher  level  of  alertneaa  of  tha  faunan  part 
of  the  Intelligence  operation  than  the  nore  atrletly  clerical  aapeet  of  the 
i reporta. 

3. 2. 3.3  Likelihood  Katlo 

we  note  that  a second  presentation  of  Bayes*  theoren  makes  a re- 
interpretation In  terns  of  likelihood  ratio  practical.  We  regard  the  quotient: 

M.)  - |-H 

i as  definition  of  the  betting  odds  on  an  event  e or  "fact"  a.  For  example , If 
the  fact  la  as  llkaly  to  be  false  as  It  Is  to  be  true,  then  the  odds  for  the 
fact  la  unity.  On  the  other  hand.  If  there  Is  only  a slight  chance  of  the  fact 
^ being  false  (l.e..  <•>  ■ 0)  then  the  odds  of  the  fact  la  very  high.  This  approx- 

I Imates  the  assumption  of  an  Inference  system  which  Is  organised  as  If  the  data 

^ and  rulas  are  completely  certain. 

Va  also  observe  that  the  quotient: 

X(e-E  ) - 

■ay  be  regarded  as  the  likelihood  ratio  of  the  report  bearing  on  the  fact. 

For  exampla.  If  the  truth  of  the  fact  e and  the  falseness  of  the  sane  fact  are 
equally  likely  to  lead  to  the  report  R^,  then  the  likelihood  ratio  of  the 
report  la  imlty.  On  the  other  hand.  If  there  Is  very  little  chsBce  of  getting 
the  report  In  the  event  that  the  fact  la  falsa  (l.a.,  ^S^R^>  B 0)  than  the 
report  has  a very  high  llkallhood  ratio.  In  this  ease,  the  report  can  ba 
thought  of  as  very  assuring. 
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3. 2. 3. 4 iMtat— nt  of  Bay*  Thtor«B  U»lnt  Likelihood  Ratio 


Thua,  Bayaa'  Thaoraa  can  ba  raatatad  in  the  following  aannar.  The 
poatarlor  (after  the  report)  odda  of  a fact  la  equal  to  the  prior  (before  the 
report)  odda  aultlpllad  by  the  report  likelihood  ratio.  It  la  Intaraatlng 
'to  trace  the  algebraic  davalopaant  of  the  viewpoint  from  the  original,  tradi- 
tional preaantatlon  of  the  Bayaa  Thaoraa. 


Aa  presented  above,  Bayea'  reault  can  be  stated  thus: 

<H  -►  D>*<H> 


<D  -►  H>  • 


<D> 


We  can  also  write  the  coaplaaantary  fora 

<H  -►  D>*<H> 


<D  H>  • 


<D> 


Taking  the  ratio  of  the  two  forma,  we  have 


<D->H>  <H  D>  <H> 

<D  fi>  <H  D>  <H> 

We  can  call  the  old  odda  on  H or  L oij  (H) , and  the  new  odda  on  H 

8 u ^ u 

(considering  the  naw  datua  or  evidence,  D)  (H).  The  factor  ~ la  the 

<i  -►  D> 

likelihood  ratio  L(H  "*■  D).  Vlth  these  notatlonal  shifts  we  have  the  odda/llkll- 
hood  formulation  of  Bayes*  Theorem 

Lnew  (H)  - KH  - D)-Lold  W 

Using  an  event  a as  the  hypothesis,  and  a report  of  event  a,  R«,  aa  the  datua, 

we  have 

»*new  <•>  • *<•  - *e>  ^ld<*> 


where  we  have  used  ”L"  to  denote  the  odds  of  the  fact,  and  X the  likelihood  of 
the  report  B,,  aa  already  dlscussad  above. 

Thus  the  likelihood  ratio  X(e  B«)  can  be  viewed  as  a factor  which 
traoaforwa  old  odds  into  new  odda, 
where  ^ 
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or  tiro  reports,  and  R2,  and  aoM  initial  odds  of  an  event  L^^Cel^  vc  have 
first 


and  than 


L„l(0  - - Ri)-Lo(s) 


• ^1'*  *2^’**o<*> 


Thus  the  overall  likelihood  ratio  is  the  product  of  the  individual  likeli- 
hood ratios 


ifhere 


**n2  " 


X • ^2*^2 


This  of  course  can  be  generalised  so  that  for  n reports  of  an  event  c 

^ " l«i  ^1^*  *i^ 

3. 2. 3. 5 Value  of  Reports  Bearing  on  a Given  Fact 

The  report  likelihood  ratio  is  the  essential  Udieator  of  ehe  value 
of  a report,  and  the  Bayes  Theoren  (likelihood  presentation)  shows  how  the  value 
of  the  report  is  realised  in  increasing  the  likelihood  ratio  of  the  fact  upon 
which  the  report  bears.  For  example,  suppose  we  compare  two  possibilities: 


(A) 


(B) 


report  likelihood  ratio  of  2, 


likelihood  ratio  of  4. 


Ve  also  assume  that  all  three  reporta  are  independent,  that  is,  that  they  do 
not  overlap  sipilfleantly  with  each  other  or  with  the  reports  which  have  been 
previously  asslmilatad  into  the  system,  resulting  in  a eurrent  ^(2,7)> 
estimata.  Tha  reporting  of  (A)  and  of  (!)  are  of  similar  value,  the  eemputation 
proeaading  thus: 


hmt  • <2H2)  CmA(2,7)] 

*'«ew  - («)  J-old  C»<2.7)] 
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What  thlc  aaana.  In  the  avant  ■ .80,  la  aa  followa: 

<WA(2,7)>^j^  - .80 

L..rWAf2.7)1  - - ^0  - 4 

old  L ' » a 


2.7)> 


*-naw  0*^(2. 7)]  - (4) (4)  - 16 

Wa  can  recover  the  probabilitlaa  (P)  fron  the  odda  (L)  aa  followa: 

L • — 

P 1-P 


P - L - LP 


P CW-L)  • L 


Therefore,  in  the  above  exaaple 


<«4(2,7)>  ^ - ^nev  i .944 


1 IWA(2.7)J  17 

II  €w 


We  note  that  thla  offera  a quick  method  of  eatimating  the  effect  of  a large 
number  of  reporta  of  aimilar  value  (l.e.,  with  aimilar  likallhood  ratioa). 

3.2. 3. 6 Operational  Featurea.  Bavea  Method 

Aa  aa  alternative  illuatration,  we  eonaider  again  the  example  of 
two  reporta  uaad  before  the  firat  mention  of  the  Bapea  Theorem: 
^-»IIA(2,7>  - .75  (8o  Rj  report) 

4l2-»liA(2,7)>  - .80  (Mo  Rj  report) 


where  the  eredibilitp  number  .75  ia  e prehahility  aatinate  that  the  R^  report 
la  true,  haaed  on  the  R^  report  alone,  and  almilarly  f or  tibe  R^  report.  We 
alao  aaawe  that  theae  are  the  only  two  current  reporta  hearing  en  the  fact 
tlA(2,7),  Uhieh  ia  new  to  he  brought  up  to  date  for  the  firet  time  after  a 


I 


long  period.  It  Is  also  assusMd  that  the  reports  arc  non-overlapping  (one 
sight  have  bean  fros  a payroll  list  observation,  the  other  from  a sighting 
of  person  #2).  Therefore,  utilising  alone,  the  best  that  can  be  done  is 
to  enter  in  the  fact  file: 


•75,HA(2,7)  (Rialonc) 

This  ease  exanple  was  utilised  in  studying  the  is^ortance  of  the 
report  likelihood  ratio: 

1 [WA(2,7)->  R,]  - <W^(2,7)-»  R^> 

^ <ta(2,7)-a  R^ 

The  subtleties  In  the  evaluation  of  the  ratio  led  to  the  refomulatlon  of 
Rayas'  theorea  la  terns  of  odds  of  facts  and  likelihood  ratios  of  reports: 


>•.»<•>  ■ »<*-»  *.> 


which  in  this  ease  beeones: 


<WA(2,7)>^ew  <WA(2,7)-»R2>  <WA(2,7)>^^j 

^(2,7)>^ew  * ^(2,7) -7  Rj>  <OT(2,7)>^‘j 

where  R^  is  still  the  second  report,  and  the  "new"  and  "old"  cstisates 
eorraspond  to  "after"  and  "bafore"  the  utilisation  of  report  R2.  The  relationship 
is,  of  course,  valid  for  any  report  with  the  appropriate  understanding  con- 
cerning "new"  and  "old".  The  use  of  likelihoods  aakes  the  problem  easy, 
such  as  the  introduction  of  logarithcu  in  sons  aritbnetic  problesw.  However, 
it  does  mean  that_there  is  the  need  to  get  the  problem  in  likelihood  language. 

In  this  essBple  that  wo^sttH-xisains. 

In  the  case  of  fact  odds  ratios,  thr'tranalatlon  is  very  easy: 

_ <HA(2,7)>old 
’ 1 - <HA(2,7^^jj 

**oid 

^(2»^>old  • L*j^HA(i,7y+  I 
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Wt  8«c  that  the  odds  rangas  from  saro  through  all  positiva  valuas,  and  la 
graatar  than  unity  for  facta  mors  llkaly  to  be  true  than  falsa.  In  addition, 
any  increase  in  the  fact  credibility  is  necessarily  associated  with  an  in- 
crease in  the  fact  odds,  and  vice  versa.  There  is  no  such  easy  transition 
for  report  likelihood  ratios.  Indeed,  the  report  likelihood  ratio,  as 
presented  above,  is  not  a fraction  whose  denominator  and  numerator  add 
up  to  unity,  as  is  the  case  in  fact  odds  ratios. 

Mow  reports  and  have  been  defined  in  the  following  manner: 

WA(2,7)>  - .75  (No  use  of  R2) 

<R2“t  MA(2,7)>  - .80  (No  use  of  R^) 

A close  eonsidaration  of  the  matter  shows  that  the  problem  is  not  completely 
defined,  because  there  is  no  clear  statement  about  the  original  WA(2,7) 
credibility  estimate  before  either  R^^  or  R2  enter  the  system.  This  follows 
from  Bayes*  formulation  Itself,  which  says  that  an  updated  fact  odds 
(or  credibility)  is  a result  of  two  things,  the  report  characteristics, 
and  the  previous  fact  as tiauktes: 

The  simpler  (likelihood)  version  of  the  Bayes  result  is  shown,  but  it  is  not 
really  important  whether  fact  credibilities  or  fact  odds  are  employed. 

An  important  thing  to  note  is  that  the  .75  and  .80  credibility  estimates 
given  above  with  R^  and  R2  correspond  to  fact  estiamtes  on  the  left  side  of 
the  Bayes  equation,  and  on  the  right  side  the  first  factor  alone  represents 
the  intrinsic  report  (R  may  be  thought  of  as  corresponding  to  R^  or  R2) 
characteristics.  The  second  (h^j^^)  factor  must  be  accounted  for,  and  a 
clear  separation  of  present  report  versus  original  fact  estimates  must  be 
achieved. 

We  do  this  by  assuming  that  h^^^UA(2,7)3  equals  unity,  tantamount 
to  saying  that  the  original  fact  was  as  likely  true  as  false  prior  to  the 
acceptance  of  either  report  R^  or  R2.  Othar  assumptions  are  considered  in 
Appendix  D.  This  means  that  Bayes*  formulation  appears  thus: 


(1) 


(No  use  of  R2) 


0.75 

1 - 0.75  ■ y3S(2,7)-*R2^ 


0.80 
1 - 0.80 


WA(2,7)-*R2 

Wt(2,7)->R2 


(No  use  of  Rj^) 


where  on  the  left  we  have  translated  (as  already  discussed)  from  fact  credibility 
to  fact  odda.  Note  that  there  la  no  difficulty  in  considering  either  Rj  or  R^ 
as  being  the  first  accepted  report.  The  results  are  that  we  have  likelihood 
astiaates  for  both  reports: 

L [WA(2,7)-v  " 3 (No  use  of  R2) 

L [wA(2,7)-VR23  - 4 (No  use  of  R^^) 


Note  that  if  we  had  assumed  a higher  value  for  the  original  (before  either  R^ 
or  R2>  odds  (or  credibility)  then  the  two  reports  would  have  had  lower 

likelihood  ratios.  This  reprasents  a real  transfer  of  system  information, 
and  lllustratas  the  significance  of  the  above  statement  that  the  initial  .75 
and  .80  report  astisMtes  do  not  completely  define  the  problem. 

The  combination  of  the  two  reports  is  simply  the  routine  of  applying 
Bayes*  formulation  through  two  stages  of  "new”  and  ’’old”.  This  double  appli- 
cation of  Bayes*  formulation  yields: 


L^snd  R2  ^ [wA(2,7)->R2]  X [WA(2,7) -»R^]  l^j^[WA(2,7)] 

-4x3x1*  12 

(^i—gjog  from  fact  odds  to  fact  credibility  we  obtain 


<«^«2.'^>\s»d  R2 


S^end  R 
hl^and  R 


12  + 1 


+ T 

2 

0.923 
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In  thl«  double  Bayes'  application,  we  have  used  our  assumption 
that  reports  «id  have  different  sources  or  come  frotn  different  in- 
formation bases.  If  this  Is  not  the  case,  but  R2  almost  duplicates  R^, 
then  a reassessment  of  report  likelihoods  is  necessary.  Suppose  that 
Rj^  (with  its  likelihood  ratio)  is  already  assimilated  in  the  fact  estimate. 
-How  the  duplicating  R2  appears  with  its  early  report  likelihood  estimate 
of  4,  This  estimate  of  4 (which  assumes  the  report  is  not  in  duplication 
at  all)  is  no  longer  acceptable,  because  such  duplication  of  evidence, 
apparently  making  the  associated  fact  appear  much  more  credible,  is  quite 
likely  without  meaning.  The  result  might  then  be  that  the  system  operator 
or  analyst,  from  his  general  information  perspective,  decides  upon  an  R2 
likelihood  estimate  (slightly  above  1,  perhaps)  depending  upon  his  Judgment 
of  the  extent  to  idiich  R2  offers  real  new  support  to  the  WA(2,7)  fact. 

Such  a situation  is  surely  operationally  important.  In  the  ease 
of  information  relating  to  people  and  technical  facilities,  it  seems 
likely  that  many  reports  will  occasionally  have  a rumor  quality  connecting 
them.  That  such  an  iaiportant  reality  is  part  of  the  estimation  of  the 
report  and  fact  data  system  is  essentially  good.  Of  course  both  the 
estimation  and  the  understanding  of  the  Information  status  strongly  Invclve 
busan  judgment. 

A record  of  previous  reports  is  important,  and  may  need  review 
as  certain  new  reports  arrive.  This  is  part  of  the  more  general  need  for  a 
journal  of  all  reports  for  general  review  and  interpretation  problems. 

3. 2.3. 7 Direct  Use  of  Source  Veracity 

When  we  have  a direct  (e.g. , subjective)  estimste  of  the  credibility 
of  a source  or,  more  precisely,  the  conditional  probability  of  an  event  given 
that  we  have  a report  of  that  event  from  a given  source,  then  of  course  the 
credibility  of  that  event  can  be  taken  as  the  credibility  (veracity)  of  the 
source.  For  example,  if  we  let  represent  a report  of  event  e from  source 
81  than  the  conditional  probability  <Ei  e>  raprasents  the  credibility  of  e 
due  to  the  single  report.  If  two  independent  sources  8^  and  $2  report  an 
event  e than  its  denial  i occurs  only  if  both  reports  are  false.  This  occurs 


with  probability  <Ej^  -►  €>*<£2  -►  i>.  The  probability  of  the  occurrence  of  e is 
given  by 

<Ej^  A E2  e>  ■ l-<Ej^  -*■  5>*<E2  -►  e> 

Thia  can  be  generalized  to  n independent  sources  as  follows: 

n _ 

< A Ej^  -*■  e>  • l-TT  <Ei  -*■  e> 
i-1  i-1 

3*2. 3. 8 Value  of  Reports,  Decision  Making 

We  have  thus  far  restricted  our  considerations  to  reports  which  all 
rclete  to  one  fact  in  the  system.  In  particular,  the  intrinsic  effectiveness 
of  the  report  and  the  degree  of  overlap  with  other  reports  have  both  entered 
the  system  with  a probability  estimate  designated  as  the  report  likeli- 
hood ratio.  We  now  mention  some  of  the  broader  considerations  affecting  report 
value  and  decision  staking. 

If  two  reports  relate  to  different  facts,  then  the  relative 
Importance  of  the  reports  will  depend  not  only  on  the  matters  already 
dlscusaed,  but  also  on  tha  relative  importance  of  the  affected  facts,  and 
also  on  their  credibility  estimates.  That  is  to  say,  one  fact  may  be  in 
greater  need  of  establishing  evidence  than  another  fact.  It  may  well  be 
that  one  fact  is  of  considerable  more  isiportance  than  another.  Soise  reports 
nay  bear  on  awre  than  one  di  tinet  fact,  and  may  have  a double  or  possibly 

treble  value. 

In  most  of  these  situations  it  appears  that  the  nature  of  the  inves- 
- tlgaticn,  the  outlook  of  the  Investigator,  and  the  time  of  the  search  may  affect 
the  situation  so  intimately  that  a formal  structure  m$y  not  be  advisable  for 
the  decision  process.  If,  for  example,  there  is  a problem  in  influencing  the 
direction  or  quality  of  reports,  then  epproprlate  searches  into  the  fact  file 
or  the  record  of  pest  reports  My  help  the  analyst,  but  his  own  opinions  and 
insi^ta  ere  ept  to  dominate  the  activity.  Similar  remarks  are  apt  to  be  per- 
tinent to  the  problem  of  the  proper  interpretation  and  disposal  of  a large 
volume  of  fresh  reports,  where  some  idea  of  the  more  valuable  reports  may  be 
helpful. 
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2.2. 3. 9 Reports  Involving  Measurement  Accuracy 


We  consider  briefly  the  reports  and  facts  involving  aeasurement 
errors  such  as  those  resulting  from  observations  of  a missile  firing  range. 
Suppose  that  facts  are  in  the  system  such  as 

Range  (17,Dtd) 

indicating  that  the  range  of  the  missiles  at  site  #17  have  a minimum  of  D-d 
and  a maximum  of  Dfd.  Such  facts  have  not  been  explicitly  considered  pre- 
viously because  the  manner  in  which  probability  is  needed,  and  the  associa- 
tive data  search  possibilities,  have  both  appeared  simpler  in  nature  than 
in  the  case  of  facts  not  Involving  measurement  error,  such  as  those  concerning 
people  and  their  employment. 

There  is,  of  course,  an  clement  of  probability  in  such  system 
facts  in  the  degree  to  wliich  D , and  D are  assigned  so  as  to  include  all 
possible  unusual  firings.  This  is  more  a matter  of  routine  variability  in 
observation  circumstances  than  a matter  of  essential  report  and  fact  cred- 
ibility. Traditional  statistical  approaches  appear  appropriate  where 
measurement  accuracy  is  such  a factor. 

One  possible  method  is  to  compute  a new  (Dtd)  pair  as  a result  of 
every  new  report  giving  the  Nth  range  reading  D^  for  missile  site  #17.  A 
simple  weighting  faetor«may  be  used  in  adjusting  the  old  fact  so  as  to 
include  the  new  report  Rj,.  For  example,  •<  - 1/10  %»uld  mean  that  the  new  report 
would  receive  a 1/10  weight  and  the  old  fact  a 9/10  weight. 

Thus,  a new  value  for  the  mid  point  of  the  range  might  be  simply 
given  thus: 

■>.»  - (I  -x ) »„.)  + - 

To  got  the  new  accuracy  estimate,  the  ideas  of  variance  and 

standard  deviation  in  a normal  statistical  distribution  may  be  used.  Thus: 
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SBCnOfclV.^vCPMSISTENCaf  mg.YSIS 

Wc  examine  here  the  question  of  consistency  In  an  Information  system 
which  contains  propositions  (explicit  facts),  generalized  statements  with  quanti- 
fied variables  (rules),  and  which  utilizes  a system  of  inference  to  derive  im- 
plicit facts,  as  well  as  retrieve  explicit  facts,  in  responding  to  queries. 

We  view  the  question  of  consistency  in  an  intelligence  system  such 
as  STIS  as  one  of  insuring  that  the  facts,  rules,  and  credlbllties  accessible 
to  the  analyst  as  accepted  information  represents  a coherent  set  of  beliefs 
sbout  the  real  world.  This  is  taken  to  mean  that  the  system  should  not  be  able 
to  derive  deductively  a proposition  and  its  negation,  and  that  the  credibilities 
assigned  to  the  propositions  (facts  and  rules)  conform  to  the  axioms  of  proba- 
bility theory.  It  can  be  shown  (*)  that  unless  the  subjective  probabilities 
of  A ast  of  beliefs  of  s given  person  conforms  to  the  axiom  of  the  probability 
theory,  then  It  is  possible  to  construct  a lottery  which  the  person  always  loses, 
independent  of  the  true  state  of  the  world. 

* F.L.  lansey;  "Truth  and  Frobabillty"  Pgs.  61-92  in  "Ryburg" 
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Th*  question  of  consistency  will  be  exsmlned  in  two  stages.  The 
first  stage  uses  the  system's  deductive  capability  to  attempt  to  assure  a 
Concept  Net  of  facts  and  rules  which  are  deductively  consistent.  This  phase 
ignores  the  question  of  credibility  and  is  called  deductive  consistency.  The 
second  stage  utilizes  a dialog  with  the  analyst  to  develop  a coherent  set  of 
credibilities.  This  is  called  inductive  consistency. 

4.1  DEDUCTIVE  CONSISTENCY 


Each  candidate  statement  (fact  or  rule)  %rt)cther  it  be  a query  or  an 
addition  to  the  data  base  (statement  corpus)  can  be  considered  as  a hypothesis 
whose  derivabillty  or  consistency  relating  to  the  data  base  is  to  be  tested. 

Initially,  the  problem  can  be  viewed  in  the  context  of  a conven- 
tional deductive  logic  system.  Relative  to  some  valid  subset  of  the  corpus, 
one  of  the  following  cases  holds  for  any  new  statement. 

Case  1.  The  statement  is  provable.  Either  it  is 

(a)  explicit  in  the  corpus,  or 

(b)  implicit  (derivable)  in  the  corpus. 

Case  2.  The  negation  of  the  statement  is  provable. 

Either  its  negation  is 

(a)  explicit  in  the  corpus,  or 

(b)  implicit  ( derivable)  in  the  corpus. 

Case  3.  Neither  the  statement  nor  its  negation  is 

provable.  In  this  case,  the  statement  (or  its 
negation)  is  said  to  be  (deductively)  independent 
of  the  corpus. 

Thus  we  see  the  key  role  that  the  concept  of  a hypothesis  set  plays 
In  the  system.  Although  we  have  spoken  of  a hypothesis  and  Its  negative,  more 
generally  a mutually  exclusive  and  exhaustive  hypothesis  set  should  be  con- 
sidered. A qfuary,  fact,  or  rule  is  therefore  not  considered  in  isolation,  but 
as  a mairiMr  of  a eat  of  hypotheses  idilch  arc  mutually  exclusive  and  exhaustive. 

If  the  situation  is  that  of  Case  1,  and  the  candidate  statement  is 
frovabla,  than  its  admission  into  the  corpus  does  not  amplify  the  logical  power 
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of  the  system.  Vhen  viewed  es  a query  it  is  answered  in  the  affirmative.  If 
it  is  a candidate  for  admission  into  the  corpus,  then  the  action  to  be  taken 
depends  on  secondary  objectives.  If  it  is  already  in  the  corpus,  then  the 
occurrence  of  a confirming  instance  may  be  noted,  possibly  augmenting  the  credi- 
. bility  measure  of  the  statement.  If  it  is  not  explicit  in  the  corpus,  then  the 
decision  as  to  whether  or  not  to  ouike  it  explicit  must  be  considered,  basically 
one  of  a space/time  tradeoff.  The  situation  is  akin  to  recognising  when  a 
theorem  in  any  deductive  system  is  interesting,  powerful  or  important. 

If  the  situation  is  that  of  Case  2,  and  the  negation  of  the  statement 
is  provable,  then  the  admission  of  the  original  atatesient  into  the  corpus  would 
cause  an  Inconsistency,  leading  to  the  probability  of  contradictory  statements. 
When  viewed  as  a query,  the  statement  is  answered  in  the  negative.  If  the  state- 
ment is  accepted  as  being  factual,  then  the  corpus  must  be  modified  and  rebuilt 
so  that  it  is  once  again  consistent.  If  the  converse  of  the  statement  is  ex- 
plicit, then  sia^ly  removing  it  from  the  corpus  may  be  sufficient,  although  an 
attes^t  at  derivation  is  required  to  assure  that  the  converse  cannot  be  derived 
using  rules  and  other  facts.  If  the  converse  of  the  accepted  statement  is  im- 
plicit, then  an  examination  of  its  derivation  is  required  so  that  proper  diagnosis 
and  "surgery"  can  be  performed. 

If  Case  3 holds,  and  neither  the  statement  nor  its  negative  is  provable, 
then  the  statement  may  be  considered  deductively  independent  of  the  corpus  and 
its  acceptance  would  be  a distinct  amplification  of  its  problem-solving  power, 
deductive  or  otherwise.  The  situation  is  akin  to  adopting  an  axiom  in  a deduc- 
tive system,  and  tha  questions  of  interest,  power  and  importance  which  were 
raised  with  regard  to  accepting  a derivable  theorem,  as  in  Case  1,  are  also 
appropriate  here. 

Actually,  this  description  of  Case  3 is  somewhat  of  an  nversiaplifica- 
tion  as  it  is,  in  general,  theoretically  impossible  to  determine  by  a mechanical 
procedure  that  a given  statement  in  the  predicate  calculus  is  not  derivable  from 
a set  of  axioom.  What  will  happen  is  that  sosMtisMs  a atatesient  which  is,  in 


fact,  thaoratically  darlvablc  £ro«  the  corpus  will  be  said  to  be  non-derivable 

because  an  arbitrary  resource  (apace/ tine)  constraint  on  the  derivation  process 

M 

has  been  axcaaded,  and  the  process  is  prenaturely  terminated.  However,  in  a 
practical  sense,  this  situation  is  not  catastrophic,  since  if  the  derivation  is 
sufficiently  difficult  or  expensive,  then  the  incorrect  answer  of  *^o”  to  a 
question  whose  correct  answer  is  "yes"  has  the  effect  of  either  accepting  as  an 
axiom  a true  statement  which,  in  fact,  is  derivable  (a  non-in jurious  error), 
or  accepting  as  factual  a statement  i^ieh  is  in  some  sense  contradictory  to  the 
accepted  corpus.  If  the  situation  of  accepting  a non-derivable  statement  into 
the  corpus  is  always  viewed  as  a competition  among  disjoint  hypotheses,  then 
there  is  a buffering  effect  due  to  the  imposition  of  the  (manual  or  machine- 
aided)  inductive  process  of  accepting  one  of  a set  of  competing  hypotheses. 

On  the  other  hand,  the  general  non-decidability  of  theorems  in  the  ^ 

piadicate  calculus  does  not  mean  that  every  attempt  at  deriving  a non-theorem  | 

will  in  fact  exceed  the  resource  limit.  There  will  be  many  practical  situs-  ^ 

tlQos  In  which  the  derivation  process  will  terminate  in  failure  because  the 
possibilities  (rather  than  the  resources)  have  been  exhausted.  | 

The  act  of  choosing  a mend>er  of  a set  of  competing  (consistent)  | 

hypotheses  is  an  essential  ingredient  of  a state-of-af fairs  system.  It  is  at  | 

point  that  the  probabilistic  nature  of  the  corpus  must  be  considered,  and  | 

It  is  this  aspect  which  allows  a rational  evaluation  of  the  hypothesis  set  and  | 

the  possible  admission  of  a atesiber  statement  into  the  corpus.  The  realm  of 
isiduetive  logic  replaces  that  of  deductive  logic;  : 

j ...  ■ I 

! The  situation  in  a state- of -affairs  problem  is  not  one  in  which  a 

i I strict  two-valued  logic  always  applies  and  statements  are  either  true  or 

false,  but  one  in  which  there  is  a grey-scale  or  continuum  of  truth  value,  or 
credibility,  over  the  interval  (0,  1).  The  credibility  of  some  statement  S f: 

will  be  interpreted  as  a probability  of  truth  and  will  b«  written  as  <S>. 
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lUCTlVE  CONSISTENCY  AS  A COHERENT  PATTgRN  OF  CREDIBILITY 


P 


i 
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W*  vl«v  Inductive  conaistency  u a aattar  of  coaparlng  related  Infor- 
■ation,  rather  than  aearching  for  logical  contradlctlona.  A coherent  pattern 
of  credlbllltlea  will  be  developed  fron  a dialogue  reaultlng  froa  aearching 
out  facta  bearing  on  an  Initial  Inquiry. 

The  llluatratlon  uaed  here  Involvea  a pattern  of  credibility  ex- 
tended over  varloua  ayatea  facta.  Starting  froa  an  aaauaed  Inquiry,  theac  facta 
arc  related  to  one  another  by  logical  Inference.  Thla  will  then  be  expanded  to 
ayatea  facta  related  to  one  another  In  a tlaa  or  hlatorlcal  acnae,  and  then  to 
facta  vhoae  relatlonahlp  la  of  even  greater  generality. 
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The  lapact  of  the  Inquiry  dialogue  la  to  llluatrate  the  nature  of 
conalatcncy  and  the  laportance  of  effective  conaunlcatlon  between  the  ayatea 
and  the  uaer.  In  later  paragrapha  It  la  caphaalaed  that  data  structure  dealgn 
la  laportant  In  enabling  thla  coamunlcatlon.  At  that  tiae  broader  pattema  of 
ayatea  facta  and  Inqulrlea,  In  addition  to  the  preaent  one,  arc  conaldcrcd. 

4.2.1  Conalatcncy  Background 

It  appeara  that  the  uac  of  credlbllty  (or  aubjectlvc  probability) 

In  an  Inference  ayaten  changca  the  nature  of  the  conalatcncy  problca.  There 
la,  of  courae,  aoae  variety  In  the  nature  of  poaalble  Inconalatency  in  an 
Inference  ayatea  without  the  uac  of  credibility.  A direct  claah  In  atatcaenta 
or  derived  atatcaenta  aay  arlae  bccauae  of  claahea  In  the  reporta  aade  to  the 
ayatea,  and  thaae  reported  claahea  aay  not  alwaya  be  ovbloua.  In  addition, 
there  la  alao  the  poaalblllty  of  an  Inconalatency  arlalng  froa  faulta  In  the 
prograaalng  or  logic  uaed  in  the  coaputer,  or  in  the  uac  of  the  ayatea  aade 
by  the  operator  or  analyat.  It  aeeaa  likely  that  the  appropriate  action  ahould 
be  to  rcaova  the  obaerved  Inconalatency  by  laprovlng  or  ralnterpratlag  the 
reporta  aade  to  the  ayatea,  or  otherwlae  attacking  the  root  eauae  of  the  claah. 

The  Introduction  of  credibility  widens  considerably  the  spectrua 
of  possible  Inconsistencies,  and  brings  In  new  subtleties.  Suppose,  for  ex- 
aaple,  that  a stataaant  la  stored  In  the  data  baae  with  a credibility  estlaate 
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of  .75,  and  y«t  th«  statatnt  la  darivad  froa  othar  ayataa  data  (facts  and 

rulaa)  with  tha  aatloate  that  tha  eradlblllty  of  thla  aaaa  atataaant  la  .90. 
Suparflclally,  thla  night  aaaa  a danaglng  Inconalatancy.  On  tha  othar  hand, 

It  nay  ba  tha  raault  of  using  highly  rallabla  facts  with  a highly  cradlbla  rule 
to  gat  tha  aaaa  atataMnt  with  a auch  hlghar  eradlblllty  than  tha  aatlaatad  ona 
whan  tha  atataaant  was  antarad.  Thus,  not  only  ara  thara  naw  typaa  of  Incon- 
slatanclas,  but  thara  ara  naw  aubtlatlas  in  thalr  Intarpratatlon  and  In  the 
approprlata  action.  If  any,  to  ba  takan.  It  la  not  Inconcalvabla  that  too  auch 
conalatancy  should  ba  a causa  for  suspicion,  as  whan  wltnaasas  to  a lagal  casa 
give  axcaadlngly  pat  taatlaony.  A great  daal  of  corroboration  In  a state  of 
affairs  nay  reflect  real  outside  clrcuastancas  but  It  nay  also  reflect  an 
organized  attempt  by  an  adversary  to  sail  a particular  alslaadlng  belief. 

Tha  aasense  of  tha  Inductive  consistency  problan  can  ba  Illustrated 
as  follows.  Assume  we  have  a sat  of  facts  which  ara  Interrelated  by  a sat  of 
rules  of  tha  form  a ^ h.  Tha  praalsa  a asy  ba  s conpound  proposition  but  for 
this  discussion  It  can  ba  assunad  (without  loss  of  generality)  to  be  a simple 
statanant.  Tha  situation  Is  Illustrated  below. 


Wa  have  the  facts  (a f)  with  cradlbilitias  {<a>,..<f>)  and  the  rules  a — c, 

, — ^ d,  c ^ a,  d ^ a,  b d,  and  d — > f.  Each  of  the  rules  In  the  form 
« h has  s strength  given  by  a pair  of  conditional  credibilities  {<e  h>, 

<a  -►  h>).  Tha  relationship  among  tha  probabllitias  can  be  darivad  as  follows: 

<h>  ■ <e  A h>  + <1  A h>  • <a>  <e  h>  + <a>  <i  -►  h> 

Thus  It  Is  clear  that  all  tha  cradlbilitias  cannot  ba  assigned  independently. 
Prom  tha  diagram  it  Is  clear  that  tha  problem  la  compounded  by  tha  fact  that 
many  facts  can  ba  darivad  through  several  Independent  paths  (a.g.,  facts  c,d,e, 
and  f). 
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To  llluatrato  this  problra  in  its  oliiploot  fora  conoldcr  • report  or 
oboorvatioB  E rolovant  to  eh«  ovont  •.  Mo  can  ospud  the  above  equation  to 
abow  the  new  credibility  of  the  hypotheaia  h,  or  <Z  h>. 

<E  -*•  h>  • <E  e>  <e  h>  ^ <E  i>  <l  «*■  h> 

<E  •*  a>  ia  the  credibility  of  the  event  e la  light  of  the  new  evidence  E.  If 
E ia  non~relevant  to  e then  <E  e>  ■ <e>  and  we  have 

<E  -*■  h>  • <e>  <e  h>  + <1>  <i  h>  • <h> 

Thua  the  non-relevant  evidence  doea  not  change  the  prior  credibility  of  the 
hypotheaia. 

Conaider  the  following  exai^le.  Suppoae  we  have  the  rule:  If  peraon 

a vorka  at  facility  F than  peraon  a worka  on  equlpaeat  E. 


Let  e >UA(a,P)  (peraon  a worka  at  facility  F.) 
h «VP0(a(E)  (Peraon  a worka  on  equipaant  E.) 

<e>  ■ . 2 (There  are  5 placea  a can  work. ) 

<h>« .5  (There  are  two  equipnanta  a can  work  on.) 

Suppoae  the  rule  e ^ h haa  the  atrength  (.1,  .7),  that  la  <i  h>  ■ .1  and 
<e  h>  • .7  (if  a worka  at  F the  probability  ia  .7  that  he  worka  on  E,  but 
if  he  doean't  work  at  F the  probability  ia  .1  that  he  worka  on  E).  Conaider 
a non-ralevaat  report  Eo  ao  that 


Then 


• <a>  ■ .2 


<Eo  - h>  - (.7)  (.2)  + (.1)  (.8)  - .22 

In  other  worda,  non-relevant  evidence  haa  changed  the  credihility  <h>  ■ .5  to 
<Eq  h>  " .22.  Now  conaider  e relevant  report  1^^  with  e>  ■ .66.  Then 

<Ei  h>  - (.7)  (.66)  ♦ (.1)  (.33)  - .495 


Even  a ralevant  report  with  credibility  .66  haa  failed  to  iacreaae  the  prior 
credibility  of  the  hypotheaia.  Thia  Uluatratea  the  fact  that  the  credibllltlea 
<e>,  <h>,  <e  h>(  and  <i  h>  cannot  ba  aaaigned  independently  but  are  bound 
by  the  derived  relatioaahlp.  Nhea  Ineonaletenclea  ia  the  aaaigned  credibllltlea 
occur  they  ahould  be  reaolved  through  aeaa  proceaa. 
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A wide  variety  of  consistency  difficulties  are  considered,  some  of 
the  most  natheaatlcal  ones  being  Illustrated  in  Appendix  E.  A leading  tech- 
nique in  handling  these  natters  is  suggested  as  an  Intimate  node  of  dialogue 
between  the  cosq>uter  and  the  analyst,  thus  naking  the  nature  of  the  consistency 
picture  apparent  to  the  analyst,  and  placing  the  interpretation  and  any  action 
directly  under  human  supervision.  This  is  Illustrated  by  using  an  example  of 
such  an  analyst  computer  dialogue,  parallel  with  side  comments. 

4.2.2  Example  For  Interactive  Mode  Of  System  Operation 

We  Illustrate  the  more  normal  Inconsistencies  expected  as  a result 
from  a query  or  Investigation,  taking,  as  an  example,  a dialogue  between  analyst 
and  computer.  These  Include  clashes  between  ordinary  STIS  facts  and  facts  de- 
rived through  the  Inference  process,  both  as  to  the  nature  of  the  fact,  and 
as  to  the  credibility  estimate  for  a fact  whose  logical  nature  is  unchallenged. 

This  dialogue  example  has  evolved  from  a concept  of  the  search  pro- 
cess in  answering  a query  to  the  system,  which  will  be  described  first.  The 
ala^lest  situation  Is  that  in  which  the  query  can  be  immediately  answered  by 

searching  the  fact  file  without  utilizing  the  inference  capacity.  The  next 
simplest  situation  is  that  in  which  a single  application  of  one  rule  is  ade- 
quate to  answer  the  query.  This  may  also  be  regarded  as  a response  using  the 
original  facts  together  with  the  first  generation  of  derived  facts.  The  idea 
may  be  further  pursued  into  consideration  of  an  additional  second  generation 
of  derived  facts  corresponding  to  a second  use  of  a rule  from  amongst  the  rules 
file. 

The  method  actually  contemplated  for  a normal  query  response  is  very 
different  from  a wholesale  computing  of  one  generation  of  derived  facts  after 
another.  It  suy  be  that  such  a procedure  should  be  used  in  a restricted  way 
imder  appropriate  circumstances,  but  it  is  apt  to  lead  to  an  awkwardly  bulky 
volume  of  derived  statements.  We  anticipate  using  only  inference  rules  which 
appear  likely  to  generate  the  query  answer.  We  expect  to  search  only  that  por- 
tion of  the  data  file  containing  statements  of  the  type  required  by  the  rule  in 
use.  In  the  analyst /computer  dialogue  described  below,  a convenient  dialogue 
Interval  is  often  that  corresponding  to  the  system  utilisation  of  an  inference 
rule. 
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Ws  start  tharafora  with  aystsa  InforMtloo  Including  tha  following 

facts  and  rules  (praeaadad  by  tbalr  eradlbllltlas): 

Facts 

81 

0.75,  ¥0(1,2) 

parson  #1  jprks  m systan  #2 

82 

0.85,  114(1,4) 

parson  #1  works  at  facility  #4 

84 

0.98,  PO(3,2) 

systan  #3  Is  £srt  of  systan  #2 

85 

0.80,  ¥0(6,3) 

86 

0.75,  WW(7,6) 

parson  #7  works  irlth  parson  #6 

89 

0.70,  ¥4(7,6) 

810 

0.95,  ¥0(2,2) 

811 

0.95,  ¥4(2,4) 

812 

0.65,  ¥4(6,4) 

821 

0.90,  ¥0(7,3) 

822 

0.95,  ¥0(10,3) 

823 

0.90,  ¥0(21,3) 

824 

0.95,  04(11,2) 

systan  #11  Is  developed  at  facility  #2 

14 

(.05  , 0.98)  WA(x,s)  A WW(x,y)-9>¥4(y,s) 

16 

(.02,  l.OO)  ¥4(x,s)  A W0(x,y)^  DA(y,s) 

17 

(.05,  0.80)  OA(y,s)  A P0(x,y)  ^ 0A(x,s) 

Wa  also  as  SUM 

that  the  abowa  Inforaatlon  Is  lllustratlwa  of  thousands  of 

oth«r  statcMBt*  In  thn  data,  mtd  dosana  ot  othar  rulas.  H*  axpact,  also,  that 
paofla,  faellltlas  and  systsas  ara  iavolvad  in  tha  inforoatlan  basa.  In 
this  anayla  «a  assoM  300  paopla,  30  faellltlas  and  45  systSM. 

Tha  msibars  to  tha  laft  of  tha  statasMnts  ara  tha  probability  astl- 
■atas  of  tha  truth  of  aaeh  statasMnt.  Tha  largar  nusd>ar  to  tha  laft  of  aaeh 
rula  la  tha  probability  astiaata  of  tha  truth  of  tha  rula  eonsaquant  in  tha 
eaaa  that  tha  antaeadant  atataMnta  ara  totally  eartaln«  Thasa  hava  baan  asn- 
tlenad  In  aarllar  paragraphs. 
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Tb«  Mullnr  ntaibcr  to  the  left  of  each  rule  is  • refinement  in  prob> 
ability  eetimation  mentioned  in  paragraph  3. 2. 2. 2.  It  is  the  probability  esti- 
mate of  the  truth  of  the  rule  consequent  in  case  the  antecedent  of  the  rule  is 
surely  false.  Notice,  for  example,  that  DA(7,2)  can  be  estimated  as  1/30  likely 
true  without  any  antecedent  at  all,  and  without  any  direct  data  Information, 
‘-purely  on  a pot  luck  basis  astongst  30  facilities. 


4.2.3  The  Investigative  Dialogue 
DIALOGUE 

Q.  (Analyst):  What  is  the  direct 

Information  on  where  system  #3  Is 
developed? 

A.  (Computer) : None 

Q. : What  is  the  story  on  first  level 

Inference  Information? 

A. : There  are  two  rules : 

R6(.02,1.00)  WA(t.x)AW0(t,3)>^DA 
(3,x).  This  means  a search  through 
up  to  300  people  at  up  to  30  fa- 
cilities. Search  prospect  Is 
fair. 

R7(.05,.80)  DA(t,x)AP0(3,t)=>DA 
(3,x).  This  means  a search  through 
up  to  45  aystema  at  up  to  30  fa- 
cilities. Search  prospect  Is 
good. 

Q. : What  are  the  results  of  the 

searches?  ' 

A.:  R6(.02,1.00)  WA(6,4) AW0(6,3)^ 

!>>A(3t4)  gives  the  result  .53. DA 
(3.4)  using  the  facts: 

85  0.80,  WO(6,3) 

812  0.65,  WA(6,4). 

R7(.05.  .80)  DA(2,x)APO(3,2)^ 
DA(3,x) 

gets  as  far  as  DA(2,x),  for  which 
there  is  no  data  statamant,  using 
the  statement: 


COMMENT 

This  asks  for  a direct  search  In  data 
through  facts  of  the  form  DA(3,x). 


The  rules  which  have  conclusions  matching 
the  original  query  are  suggested.  Note 
one  of  them  is  an  attempt  to  gain  Infor- 
mation through  en^loyment  knowledge  about 
people  on  system  #3.  The  other  rule  ex- 
plores through  systems  Including  system 
#3,  and  appears  to  have  the  inferior 
credibility  but  the  superior  search  pro- 
spect. The  search  prospect  report  may 
be  based  on  past  search  effectiveness, 
and  on  the  data  file  completeness  with 
respect  to  rule  assumption  facts. 


Here  we  observe  that  one  search  uncovers 
a low  confidence  result  based  upon  an 
uncertain  fact  about  where  person  #6 
works.  The  other  search  succeeds  only 
in  rephrasing  the  query  In  terms  of  a 
system  including  system  #3. 
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DIALOCDE 
S4  0.98,  PO(3,2) 

. Q. : Rmsbcsi  th«  truth  probability  for 

tha  R6  result  using  the  following 
nuabers : 

S3  0.85,  WO(6.3) 

S12  O.AO,  VA(6,4) 

A.:  .353,  DA(3,4) 


Q.:  Ignore  the  R6  result.  Vhst,  then, 

is  the  story  on  the  next  level  of 
Inference? 

A.:  The  R6  search  can  be  extended: 

R6(. 02,1.00)  HA(s,x)AW0(a,3)=^ 
0A(3,x)  using  the  data: 

53  0.80  U0(6,3) 

521  0.90  N0(7,3) 

522  0.95  W0(10,3) 

523  0.90  UO(21,3) 
and  the  rule: 

R4(.05,.98)  WA(t,x)AWW(t.a)^ 
UA(a,x) 

This  Beans  4 searches  through  up 
to  300  people  for  up  to  30  facili- 
tiea.  Search  prospect  is  fair. 

The  R7  search  can  be  extended: 

R7(.05,.80)  DA(2,x)AP0(3,2)3> 
SlA(3,x)  using  the  data: 

54  0.98,  P0(3,2) 
and  the  rule: 

R6(. 02,1.0)  WA(t,s)AW0(t,2)^ 
DA(2,x) 


COMMENT 


This  is  not  a statsBent  file  change,  but 
only  a side  coaputation.  The  analyst  is 
free  to  explore  his  own  conviction  or 
interests,  possibly  calling  upon  a confi- 
dence routine  not  using  ordinary  prob- 
ability ideas. 


The  first  line  of  search  can  be  continued 
by  researching  the  work  information  on 
each  of  four  persons  who  are  stated  to  be 
working  on  system  #3.  This  is  possible 
by  use  of  rule  #4  which  is  based  on  co- 
workar  information.  The  search  success 
depends  upon  the  data  file  Information 
bearing  on  the  coworkers.  Direct  Infor- 
BMtion  bearing  on  one  of  the  four  persons 
(i.e.,  #6)  has  been  of  low  confidence 
(this  resulted  in  DA(3,4),  with  probability 
which  was  reassessed).  The  second  line 
of  search  (i.e.,  starting  with  the  R7 
usage)  can  be  continued  by  an  attempt  to 
use  eBployment  knowledge  about  people 
working  on  the  large  system  #2  (includes 
#3).  The  alternate  continuation  of  the 
aecond  line  is  to  explore  systems  which 
Include  12,  which  in  turn  includes  #3. 

The  latter  might  be  identified  separately 
as  an  R7R7  search. 
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DIALOGUE 


COMKENT 


This  Mans  a search  through  up  to 
300  people  for  up  to  30  facilities. 
Search  prospect  is  fair. 

This  R6  extension  may  be  replaced 
by: 

R7(.05,.80)  DA(t,x)AP0(2,t)^ 
DA(2,x) 

This  sieans  a search  through  up  to 
45  systems  at  up  to  30  facilities. 
Search  prospect  is  good. 

Q. : Ignore  the  R7R7  search.  What,  then, 

arc  the  results  of  the  second  level 
of  inference  search? 

A.:  The  R6R4  search  using  R6(.02,1.00) 

WA(6,x)  AW0(6.3)s^  DA(3.x) 

55  0.80,  U0(6,3) 

R4(.05,.98)  WA(7,6)aWW(7,6)=>WA 

(6,6) 

56  0.75,  WW(7,6) 

S9  0.70,  WA(7,6) 

Gives  the  result  .442.  DA(3.6) 

The  R7R6  search  using: 

R7(.05,.80)  DA(2,x)AP0(3,2)=> 
DA(3,x) 

S4  0.98,  PO(3,2) 

R6(.02,1.0)  WA(a,x)AW0(a,2)=> 
DA(2,x) 

when  with  dats: 

51  0.75,  W0(l,2) 

52  0.85,  WA(1,4) 

gives  the  result  •SO.  DA(3.4), 
alternately  with: 


The  analyst  feels  that  information  gained 
through  subsystem  of  a subsystem  connec- 
tions are  not  worth  pursuing  for  the  pre- 
sent. The  analyst  now  gains  three  results, 
two  of  which  agree  with  the  earlier  re- 
sult in  suggesting  facility  #4.  One  of 
these  results  is  the  only  one  of  the  four 
at  a modestly  high  (70Z)  probability  level, 
and  this  appears  to  be  a result  of  a better 
than  average  knowledge  of  the  employment 
of  person  92.  The  overall  picture  suggests 
that  facility  9U  is  rather  likely,  and  that 
the  suggestion  that  it  is  facility  9f>  is 
suspect. 


SIO  0.95,  W0(2,2) 

811  0.95,  WA(2,4) 

gives  the  result  •70.  DA(3.4) 
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DIALOGUE 


COMMENT 


Q. : Eater  in  file: 

S9  .65,  WA(7,6) 

in  piece  of: 

S9  .70,  WA(7,6) 

Investigation  complete  (derived 
data  may  be  discarded,  etc.) 


After  consultation  with  the  file  author- 
ity, it  is  agreed  that  the  weakest  link 
in  the  suspect  DA(3,6)  result  should  be 
placed  at  a lower  confidence  level. 

Data  derived  from  an  investigation  of 
this  type  is  normally  discarded. 


4.2.4  Dialogue  Conclusions 

This  illustration  concludes  our  investigation  into  consistency  problems 
which  appear  likely  in  a normal  Investigatory  operation.  It  is  felt  that  most  in- 
consistencies have  their  roots  in  the  reports  fed  into  the  system  and  in  the  re- 
sulting system  facts.  It  also  seems  likely  that  a chief  factor  in  the  successful 
handling  of  such  problems  is  the  effectiveness  of  the  communication  between  the 
computing  system  and  the  operator/analyst.  A better  name  for  what  we  have  called 
"consistency"  might  well  be  "a  coherent  pattern  of  crediblity:. 


The  consistency  problems  treated  in  Appendix  E have  a more  special 
nature.  Such  inconsistencies  are  not  expected  to  occur  often  in  normal  investiga- 
tory procedures,  provided  the  system  probability  formulae  and  the  Inference  rules 
are  well  designed. 

4.3  INFORMATION  PATTERNS 

We  consider  here  the  broad  patterns  of  information  arising  when 
tisM  is  a dominant  clement  in  the  information  search.  Though  many  more  facts 
arc  typically  part  of  one  of  these  tiam  patterns  than  in  the  logically  connected 
Information  pattern  illustrated  above,  the  searching  decisions  show  a siadlarity. 

Search  problems  and  data  design  possibilities  involving  both  the 
original  reports  to  the  system,  and  also  facts  derived  from  those  reports,  are 
considered.  The  possibilities  of  reorganising  system  facts  or  even  introducing 
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new  facts  froa  the  original  system  reports  are  described,  using  particular  ex- 
aaplas.  Credibility  adjustments  for  aging  Information  are  also  Illustrated. 

We  begin  by  first  giving  a brief  method  for  handling  the  decay  of  fact 
'-eredlblllCy  when  (nsupported  by  new  reports  for  protracted  periods  of  time. 

Then  a nuibber  of  possibilities  for  carrying  out  a historical  Investigation  are 
considered.  The  use  of  examples,  both  with  employment  and  development  type  In- 
formation and  also  with  radar  site  type  Information,  Is  dominant  In  the  considera- 
tion of  various  alternatives. 

These  include,  for  example: 

,99,  UA(2,7)  Person  #2  works  at  facility  #7  with  a 

probability  estimated  at  .99 

Range(17,  111!)  Missile  site  #17  has  a range  capability 

generally  in  the  10  to  12  mile  Interval 

All  of  the  alternatives  have  broad  data  organization  Implications.  A 
complete  log,  recording  all  reports  entering  the  system.  Is  discussed.  Periodic 
recording  of  the  fact  file  as  a protective  and  historical  search  aid  Is  analyzed 
and  Illustrated.  Examples  of  setting  up  new  facts  and  reorganizing  old  informa- 
tion from  the  grass  roots  report  level  are  given. 

The  sumsury  suggests  a practical  blend  of  all  the  considered 
methods.  The  judpnent  in  achieving  this  blend  Is  of  the  same  general  character 
as  that  utilized  in  assigning  system  facts  from  the  great  bulk  of  atixillary 
facts  ambedded  in  the  system  reports. 

4.3.1  The  Inforsmtlon  Aging  Problem 

•m^peaa  we  have  a well  reported  and  virtually  assured  fact  In  the 

.M,  114(2,7) 

9ha  €ipa,  av  paftipB  aMhs,  this  entry  may  sarve  as  a good  astiatate.  However, 
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if  typical  employment  at  one  facility  is  for  approximately  4 years,  and  if  no 
new  reports  arrive  to  support  the  U4(2,7)  fact,  then  it  becomes  unrealistic  to 
continue  for  many  years  using  the  same  entry  in  the  fact  file.  This  dynamic 
quality  in  the  information  trill  depend  upon  the  class  of  information:  some 

facts  will  lose  validity  at  a naturally  faster  rate,  again  supposing  new  reports 
do  not  appear.  He  consider  some  of  the  general  possibilities  in  handling  data 
aging  problems. 


It  is  apparent  that  a realistic  estimate  of  the  probability  of 
person  #2  working  at  facility  #7  will  be  near  zero  at  the  end  of  a protracted 
period  without  new  reports.  This  would  mean  certainty  that  person  #2  is  not 
working  at  facility  #7,  which  is  only  likely  in  ease  the  period  is  protracted  to 
the  time  when  person  #2  is  apt  to  be  retired.  Before  retirement  is  likely, 

.05,  WAC2^7) 

might  be  a realistic  fact  entry,  supposing  the  following  to  be  true: 

(1)  The  original  reporting  bearing  on  the  fact  has  aged 
to  the  point  of  uselessness,  and  no  new  reporting  has 
appeared. 

(2)  Person  #2  is  very  likely  to  be  employed  in  some  one  of 
the  20  facilities  employing  people  with  his  type  of 
experience  (facility  #7  is  one  of  them). 


4.3.2 


The  Adjustments.  Local  Features 


It  is  conceivable  that  individual  facts  %rill  require  an  updating  pro> 
cedure  which  should  at  laast  include  a periodic  reassessment  of  facts  which  have 
not  been  reassessed  because  of  pertinent  new  reports.  For  exsmple,  in  the 
HA(2,7)  fact  illustrated  above,  assuming  no  new  reports  appear,  a quarterly  re* 
assessment  routine  might  result  in  the  following  time  pattern: 


.99,  WA(2,7) 
.94,  H4(2,7) 
.90,  U4(2,7) 
.86,  HA(2,7) 
.87,  WA(2,7) 


first  quarter 
second  quarter 
third  quarter 
fourth  quarter 
fifth  quarter 
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■o  that  «t  th«  end  of  about  throe  year*  the  UA(2,7)  fact  has  a credibility  assess- 
Bcnt  to  the  effect  that  the  fact  le  about  as  likely  to  be  false  as  true.  The 
above  work  has  assusMd  .05  as  the  sero  level  for  the  fact  Infonnatlon,  and  further 
assuned  that  all  credibility  above  the  .05  depreciates  quarterly  at  a 57.  rate: 


(.99  - .05) (.95) 

+ 

.05 

i 

.94 

(.94  - .05) (.95) 

+ 

.05 

4 

.90 

(.89  - .05) (.95) 

+ 

.05 

4' 

.86. 

It  nay  well  be  that  other  systen  facts  will  have  different  sero  levels 
and  different  depreciation  rates,  but  the  above  routine  nay  have  some  applicability 
in  accounting  for  the  Intelligence  aging  process. 

Using  the  same  data  as  already  appears  above,  namely  a sero  informa- 
tion level  at  .05  credibility,  and  a .95  depreciation  factor,  a graph  of  the 
quarterly  credibility  is  plotted  below. 


An  axpontlal  fomula  relating  the  credibility  **d"  to  the  number  of 
q**»ters  is  easy  to  devise.  We  expect  the  formula  to  follow  the  pattern: 


C-  .05  + .94e”*“ 


• - 2.718 
k * constant 
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■o  that  ffa  hava  c«.99  for  n«0  and  c«.05  for  n vary  larga.  Wa  notice  that  the 
•94  la  the  cradlblllty  above  the  zero  infomiatlon  level  (.94  ■ .99  • .05)  which 
la  aubjeet  to  decay  while  peraoc  t2  rcaialna  employed  and  while  no  new  reporta 
are  received  to  help  identify  where  ataong  the  20  facllltlea  peraco  #2  la  employed. 

The  eonatant  k can  be  determined  by  ualng  the  aaaumed  fact  that  when 
changea  by  1 the  decay  la  to  a .95  proportion  of  the  original  credibility 
above  the  .05  level.  Tfaua: 

•95  - e*^ 
log,  (.95)-  -k 

0.0512  - k 


and  the  credibility  formula  la: 


c - .05  + .94e 


-0.512n 


Thia  la  the  aamc  aort  of  thing  that  la  encountered  in  radioactive 
decay.  In  our  caae,  we  look  for  a half  life  for  the  credibility.  Thua  we 
aolve  for  "n”  when  the  decay  factor  la  1/2; 


1/2  - a 

log,T2)  - kn 

0.0512 
13.5  4n 


•kn 


Thua  the  half  life  la  between  13  and  14  quartern,  that  la.  between  3 and  4 yaara. 


Thera  are  aomc  practical  motivationa  for  axplorlng  the  above  View. 
They  concern: 


(1)  The  baaia  for  decay  aatioation, 

(2)  The  baaia  for  data  review. 
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These  are  partly  huaan  engineering  matters.  It  may  well  be  that  the 
.95  decay  constant  may  be  estimated  directly,  especially  if  such  estimation  is 
done  by  an  experienced  person.  However,  it  may  strengthen  the  estimation  pro- 
cedure to  use  the  half  life  n value  (n  ■ 13.3  quarters)  because  It  has  the 
vivid  connotation  of  being  a representative  employment  period  at  one  facility. 

In  the  same  manner,  the  half  life  may  furnish  a very  practical  time 
increment  to  review  the  fact  for  possible  retirement  to  archival  storage. 

It  is  surely  important  to  keep  the  on-line  memory  available  for  the  most  use- 
ful Information.  This  is  in  keeping  with  the  philosophy  of  selecting  only 
Important  Information  from  the  report  file  for  forming  the  system  fact  file. 

^•3*3  Time  Problems.  General  Features 

The  largely  tacit  assumption  is  often  made  that  an  investigative  search 
concerns  only  the  present  state  of  affairs  as  understood  through  reports  made  to 
the  system  and  facts  deduced  from  these  reports,  together  with  the  fact  credi- 
bility estimates.  The  time  and  report  problems  discussed  so  far  in  this  note 
suggest  specific  possibilities  for  keeping  the  system  facts  up  to  date.  At  times,  a 
search  into  the  history  of  a situation  may  be  not  only  helpful,  but  possibly 
critically  iiiq>ortant.  He  consider,  therefore,  expanding  a fact  search  to 
include  temporal  aspects. 

Suppose  then  we  have  sufficient  interest  in  the  situation  to  inquire 
into  the  likelihood  that  person  #2  was  employed  at  facility  #7,  one  year  ago 
or  two  years  ago,  as  well  as  at  the  present  time.  There  are  three  Illustrative 
possibilities: 

(1)  The  employment  history  may  be  an  essential  part  of 
the  fact  file.  This  means  that  the  esiployment  history 
of  person  #2  might  be  an  integral  part  of  the  person 
#2  entity  node  in  the  data  structure. 

(2)  A historical  fact  file  from  system  use  of  one  year  ago, 
or  also  two  years  ego,  is  used.  This  means  a general 
practice  of  periodically  keeping  a record  of  the  whole 
fact  file  in  a secondary  swmory,  to  facilitate  such 
historical  searches. 


(3)  The  cmplojnMnt  hlatory  1«  eoDetructed  fron  the  record  of 
pertinent  reports  received  by  the  eye ten.  Thle  suggests 
e Joumel-style  file  of  reports  kept  In  support  of  a 
ledger-style  file  of  facts. 

We  intend  to  consider  some  of  the  edvantages  and  disadvantages  of 
each  node  of  data  organization.  Both  becaxise  of  the  Importance  of  the  time 
element  In  Information  searches,  and  also  because  of  the  problems  in  bulk  of 
Information,  the  Issues  raised  are  apt  to  baar  Intimately  on  the  aysten 
effectiveness.  As  a preliminary  to  such  a consideration,  we  review  the 
definitions  of  such  tfords  as  "fact”  and  "report”. 


4.3.A 


Information  Definitions 


In  this  report  and  In  preceding  technical  notes  the  word  "fact"  has 
been  used  In  a narrow  sense,  as  Illustrated  by  the  following: 

.99,  WA(2,7)  Range  (17,  11+1) 

which  have  both  appeared  previously.  Our  facts  are  necessarily  only  primary 
or  important  facts,  therefore,  and  this  In  turn  Is  a result  of  htanan  decision. 
Furthermore,  It  Is  In  this  sanse  that  It  Is  expected  that  the  data  bulk  of  the 
system  facts  Is  apt  to  be  decisively  less  than  the  bulk  of  the  system  reports. 
This  Is  in  keeping  with  the  previous  study  of  the  value  of  reports  and  with  the 
patterns  of  analyzing  the  effect  of  various  (possibly  a great  many)  reports,  all 
pertinent  to  one  fact,  such  as  the  range  at  a particular  missile  site. 

On  the  other  hand.  It  Is  likely  that  aach  system  report  has  In  It  what 
may  be  viewed  as  many  auxiliary  facts.  The  fact  that  ttlsslle  site  #17  uses 
missiles  with  a 10  to  12  mile  range  may  be.  In  part,  a result  of  one  particular 
report  which  gives  a time  of  firing  and  a hwdred  successive  coordinate  missile 
positions  as  coming  from  a radar.  VC  never  normally  refer  to  such  Inforsmtlon 
as  facts,  even  though  they  literally  are  facts.  In  the  sane  spirit  we  keep  our 
special  usage  of  the  word  "facts",  in  spite  of  the  difficulty  that  our  facts  have 
all  levels  of  credibility  available,  whereas  popular  usage  suggests  totel 
certainty..  ' 


I 


A report  say  •PP**t'  that  at  a particular  tiaw  and  place  a tall  man 
named  Gerhardt,  wearing  a bright  blue  tic,  got  in  quite  a diapute  with  two  others. 
This  report  may  be  one  of  many  which  support  the  fact: 

.99.  WA(2,7) 

and  in  ao  doing  the  blue  tic  and  the  dispute  may  both  be  lost,  except  perhaps  in 
a log  or  record  of  incoming  system  reports.  It  is  quite  conceivable  that  such 
secondary  facts  may  remain  lost,  except  for  the  possibility  of  a review  of 
report  information  made  for  some  special  reason,  such  as  backing  up  an  Investlga- 
tiwe  search  where  facility  #7  is  specially  involved.  Alternatively,  it  is  con- 
ceivable that  additional  incoming  reports  may  lead  an  analyst  to  the  conclusion 
that  the  wearing  of  blufe^^may  have  special  significance,  perhaps  indicating  an 
ethnic  or  activist  group,  or  perhaps  indicating  a more  specific  signal.  With 
appropriate  authority  he  swy  initiate  a new  system  fact: 

•95 .Tie  Color  (2. blue) 

signifying  wearing  blue.  In  addition,  he  may  modify  selected  report  headers 
by  inserting  tags  to  make  retrieval  of  reports  bearing  upon  such  a fact  easier. 
Those  early  reports  which  were  not  so  identified  nay  require  more  time  consum- 
ing methods  in  order  to  bring  a newly  created  fact  up  to  date. 

When  we  speak  of  the  fact  file,  we  naan  a reference  organization  of 
inportant  facts  together  with  the  technique  for  organizing  and  searching  through  ' 
the  facts,  using  perhaps  indexing  and  network  structures.  In  referring  to  the 
report  log,  we  mean  merely. the  time  sequence  of  recorded  reports.  There  nay  be 
problems  in  deciding  whether  one  lengthy  report  should  be  considered  as  several 
conaacutlve  reports.  Zn^ referring  to  the  report  file,  we  mean  the  report  log 
and  also  the  tagging  and  indexing  techniques  which  enable  effective  searching 
of  the  reports.  This  concludes  the  preliminary  sharpening  of  the  language  be- 
fore considering  the  three  nodes  of  data  organisation  already  mentioned,  as 
a result  of  examining  time  problems  and  historical  searches. 
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Hl»tory  Dlfctly  in  th«  Fact  Fll« 


TIm  first  Mntloncd  possibility  is  to  h«vs  historical  Inforastion  in' 
eluded  as  an  asssntial  part  of  tha  fact  file,  as  a result  of  tha  usage  made  of 
tha  node  network  of  the  data  structure.  The  degree  to  which  this  historical 
Infonution  might  be  an  Integral  part  of  the  fact  file  varies.  At  one  extreme 
it  is  conceivable  that  associated  with  facts  stieh  as: 


there  might  be  the  full  record  of  all  reports  bearing  on  tha  amployment  of  per' 
son  #2  and  also  all  reports  contributing  to  range  information  of  missile  site 
#17.  That  is  to  say,  such  intimate  report  information  might  be  repeated  as 
part  of  the  attribute  information  appearing  with  the  entity  node  identifying 
person  #2.  Alternatively,  the  entity  node  identifying  missile  site  #17  might 
have  repeated  in  the  attribute  infonution  the  voluminous  radar  data  which  has 
been  the  source  of  the  site  rsnge  information. 


The  above  possibility  appears  inefficient,  partly  because  of  the  dup« 
lication  of  report  records  which  will  surely  be  necessary,  in  any  event,  as  part 
of  the  report  file  for  purposes  of  system  protaction  and  system  reevaluation  pro- 
cedures, as  illustrated  above  with  the  creation  of  tha  'Siearlng  blue”  feet. 
Another  source  of  Inefficiency  is  that  ordinary  search  procedures  may  be  impsilsil 
by  the  resultant  Inilkihess  of  the  system 'fact  file.  ' 


A better  approach  is  to  include  only  condensed  or  derived  historical 
iaformation  in  tha  fact  file,  using  the  same  sort  of  pra^eatie  judgnant  of  Isk 
portanee  and  usefulneas  as  was  illustrated  In  tha  creation  of  tha  *Vearing  blua" 
fact,  tea  possibility,  for  example,  is  that  the  attribute  Infnimst Inn  mi^t  have 
the  values  to  make  available  the  following  facts: 

.99,  HA(2,7)  ...  Rante(17,  lltl)  ...  (current) 

.83,  HA(2,7)  ...  Ranged!,  10^1)  ...  (1  yr  ago) 

•90,  NA(2,13)...(Mo  Fact)*  ...  (2  yrs  ago) 


This  might  mean  that  the  entity  node  for  person  #2  will  have  employment  location 
(and  associated  credibility)  identification  not  only  for  the  current  time  but 
also  for  the  two  praceedlng  years.  Cosiparable  comsent  applies  to  the  entity 
node  for  radar  site  #17,  where  the  assumption  is  that  there  is  no  information 
for  the  earliest  year.  We  note  that  such  a pattern  looks  good  for  a search 
into  all  the  employees  for  the  last  two  or  three  years , for  the  search  anpears 
to  be  a simple  extension  of  the  similar  one  for  current  employment.  For  a 
more  elaborate  search,  such  as  that  illustrated  in  paragraphs  4.2.2  and  4.2.3, 
special  problems  msy  arise,  because  inference  rules  are  used  to  connect  sub- 
system, coworkers,  employment,  and  development  location  information.  In  such 
a comprehensive  search  it  may  not  help  snich  to  have  historical  information 
with  the  WA  type  facts.  Yhis  swy  not  be  an  important  difficulty  because  such  a 
search  is  atypically  difficult,  and  also  because  a modest  use  of  historical 
Information  can  well  be  extended  to  various  types  of  facts. 

A more  powerful  plan  for  history  recording  in  the  fact  file  is  to  enter 
the  intervals  of  employment  as  attribute  information  associated  with  the  entity 
node  for  person  #2.  Such  a plan  would  surely  be  harder  to  implement,  and  also 
harder  to  utilize  in  the  course  of  a historical  search.  Yet  the  search  results 
are  apt  to  be  better,  and  more  flexible,  e.g.,  in  answering  searches  concerning 
the  state  of  affairs  15  months  ago.  We  do  not  pursue  details  here,  but  rather 
continue.wltht^  second  of  our  three  general  modes  of  data  organization. 

4.3.6  Use  of  Past  Fact  Files 

We  consider  now  the  possibility  of  periodically  keeping  a secondary 
record  of  the  whole  fact  file  for  the  purpose  of  aiding  historical  searches. 

This  is  likely  to  mefp  that  a more  extended  search  involving  the  past  state  of 
affair*  may  be  made,  using  a more  complete  history  than  is  available  directly 
in  the  currant  fact  file.  We  suppose  such  records  of  past  fact  files  might  be 
available  on  a quarterly,  or  perhaps  monthly  basis. 

Thera  is  m important  distinction  between  the  two  histories  that  are 
thus  considered.  On  the  one  hand.  What  is  available  night  be  a complete  history, 
but  one  which  has  the  viewpoint,  e.g.,  of  one  year  ago.  In  the  one  year  since 
many  things  My  have  happened.  Including: 
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(1)  A great  voluBt  of  now  reporta  haa  added  to  the  fa 
•ad  changed  the  old  facta  and  their  credlbllitlea 

(2)  In  the  ease  of  facta  which  have  had  no  reporta  to 
them  for  the  laat  year,  there  ia  attll  the  aging  ( 
on  the  credlbllitlea  to  be  conaidered,  aa  detaile< 
In  thla  report. 


On  the  other  hand,  the  hlatory  informatlcm  In  the  ctirrent  file,  if 
well  maintained,  utlllaea  fully  all  the  advantagea  auggested  in  the  items 
above,  aa  la  alao  true  of  the  information  about  current  affairs.  If  for  example 
aix  weeks  ago  a new  fact  has  entared  the  fact  file,  either  as  a reassessment  (as 
llluatratad  by  the  'Vaaring  blue"  fact)  or  aa  a change  in  the  state  of  affairs, 
thla  new  fact,  with  any  appropriate  history,  la  a part  of  the  current  fact  file. 
Thus,  the  past  fact  file  la  apt  to  be  leas  complete  in  this  respect,  although  it 
la  more  complete  with  respect  to  the  new  fact's  past  history. 


Just  as  keeping  a time  ordered  log  of  reports  entering  the  system 
has  a high  protective  value,  so  too  does  keeping  an  untampered  record  of  a 
past  fact  file.  An  untampered  log  of  reports  offers  opportunities  to  check 
and  reassess  information  at  the  grass  roots  level.  A valid  record  of  a past 
fact  file  protects  the  knowledge  and  insights  (all  too  easily  forgotten)  which 
helped  evolve  the  factual  picture  of  that  time  from  the  report  level.  If  it 
ia  Judged  that  they  have  sufficient  general  value,  the  improveisents  mentioned 
above  might  be  arranged  in  an  appendix  to  the  past  fact  file.  The  result 
would  be  t^t  without  the  appendix  we  have  the  old  picture  of  the  old  state  of 
affairs.  With  the  appendix  we  have  the  iaprovements  to  get  the  new  picture  of 
the  old  state  of  affairs. 


We  consider  an  example  of  a use  of  past  fact  files,  based  upon 
fictitious  eireumstanees.  We  suppose  that  we  have  in  the  current  fact  file 
the  follofrlng: 


Ranged?,  11.1^0.9) 


We  suppose  further  that  there  is  an  unusual  report  that  an  odd  vehicle  has  been 
sighted  in  the  site  #17  vicinity  which  may  possibly  deliver  a solid  propellant 
•R®**®  every  two  sunths  or  so.  It  is  also  Inown  that  the  rocket  styles  using  that 


propcllnt  often  have  mbc  •ensitivity  to  the  age  of  the  fuel.  To  learn  more 
of  the  mleelle  aite  and  It*  capability,  it  is  decided  to  research  the  firing 
history  and  also  the  misfiring  history.  Assuming  the  fact  files  are  stored  away 
on  a monthly  plan,  the  following  facts  are  retrieved; 

Ranged?,  ll.lt.9)  ...  Fd7,8,0)  ...  (June) 

Ranged?,  ll.St.9)  ...  F(l?,14,0)...  (May) 

Ranged?,  ll.lt.9)  ...  F(l?,15,0)...  (April) 

Ranged?,  ll.stl.O)...  F(l?,14,2)...  (March) 

For  the  current  sionth  of  June  the  above  file  facts  mean  that  the  bulk  of  the  8 
firings  were  in  the  range  capability  interval  from  10.2  miles  to  12.0  miles. 

For  the  month  of  March  the  firing  record  shows  two  misfires  and  14  normal  firings. 
Ve  also  assume  that  each  new  firing  has  a 5%  Influence  (as  described  earlier  in 
this  note)  in  changing  the  old  range  limits  to  the  new  range  limits. 

An  examination  of  the  file  history  lends  a weak  support  to  the 
possibility  that  the  site  range  capability  varies  with  a two  month  period.  But 
it  stay  well  be  worthwhile  to  reconstruct,  from  the  system  report  log,  the  shot- 
by-shot  range  capability  story.  This  has  never  heretofore  been  entered  in  the 
fact  file.  Depending  upon  the  results  of  such  an  investigation,  and  upon  their 
importance,  future  procedure  may  be  to  enter  further  facts  in  the  fact  files  to 
improve  the  system  performance  characteristics. 

In  a more  general  sense,  related  Investigations  for  other  missile  sites 
My  be  tndertaken.  The  possibility  of  obtaining  and  organizing  further  transport 
information  may  also  develop. 

4.3.?  History  From  The  Report  File 

In  all  the  examples  so  far  given  the  report  file  has  appeared  as  a 
sort  of  last  resort  in  the  reconstruction  or  reinterpretation  of  information. 
Hhather  it  is  a report  giving  miss lie- firing  radar  position  data,  or  a report 
supporting  an  employmant  or  system  development  fact,  it  appears  that  the  report 
file  is  a repository  of  a great  nuiri>er  of  auxiliary  or  secondary  facts  which  will 
only  rarely  be  referred  tw.  The  13th  x-coordinate  position  value  in  $ radar 
sighting  of  a missile  is  not  apt  to  be  searched.  Likewise  a particular  circum- 
stance in  the  fourth  reported  observation  supporting  the  fact  that  person  #2 
works  at  facility  #?  is  not  likely  to  matter. 
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Y«t  it  h*s  seemed  important  to  have  a complete  log  of  all  reports 
entering  the  system,  appropriately  tagged  and  indexed.  It  may  be  that  in  some 
cases  the  report  log  tag  identifying  missile  site  #17  may  be  used  to  help  recon- 
struct a more  detailed  firing  picture  than  is  normally  kept  in  the  fact  files , 
because  new  reports  have  caused  opinion  to  change  about  what  Information  is 
important,  perhaps  even  to  the  point  of  setting  up  new  facts  in  the  fact  file. 

On  the  other  hand,  the  tagging  system  may  be  largely  useless,  as  in  the  odd 
case  described  above  in  searching  for  "wearing  blue"  information.  Here  the 
search  interest  may  be  such  that  nearly  all  reports  received  during  a particular 
time  interval  will  have  to  be  inspected  because  the  indexing  plan  did  not  antici- 
pate what  would  be  important. 

4.3.8  History  Implementation  Summary 

A method  of  organizing  information  to  enable  historical  searches  has 
been  considered. 

The  foundation  Is  a well  tagged  and  Indexed  log  of  all  reports, 
made  as  they  enter  the  system.  This  has  been  called  the  report  file,  and  may 
be  thou^t  of  as  the  main  journal  of  sn  information  business. 

The  ledgers  of  this  information  business  are  the  current  fact  file 
and  the  set  of  past  fact  files,  possibly  put  in  secondary  memory  every  month;  or 
at  whatever  time  interval  is  useful.  These  facts  constitute  a much  less  volum- 
inous body  of  data  than  the  reports , and  they  are  the  result  of  human  Judgments 
of  importance.  It  is  anticipated  that  the  bulk  of  investigative  searching  will 
take  place  over  the  restricted  infonsation  of  the  fact  files. 

The  extent  to  which  historical  information  is  already  a part  of  each 
fact  file  is  determined  by  the  same  sort  of  human  jud^sent  as  is  asiployed  in 
initially  setting  up  the  facts  of  the  fact  file.  It  is  expected  that  there  will 
be  a lot  of  traffic  in  reorganizing  the  fact  structures  and  identities  as  new 
infomation  and  Insights  are  gained.  This  appears  to  be  a chief  characteristic 
of  intelligence  information,  and  is  a reason  for  the  use  of  node  network 
structures  in  the  data  organization. 
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SECTION  V 


PROGRAM  FUNCTIONAL  SPECIFICATIONS 


Th«  scope  of  the  program  specifications  is  examined  from  the  view- 
point of  how  the  STIS  functions  are  actually  affected  by  credibility  and  con- 
sistency procedures*  We  start  with  charts  indicating  the  relationships  between 
these  program  specifications  and  preceding  sections. 

The  result  of  this  examination  is  the  selection  of  five  STIS  func- 
tions to  be  specified  because  of  the  Impact  of  credibility  and  consistency 
considerations.  Two  of  these  are  for  routine  updating  of  the  credibility 
of  STIS  facts  using  probability,  and  the  routine  updating  of  the  statistical 
estimates  for  STIS  numeric  facts,  respectively.  A third  function  provides 
for  e credibility  aging  allowance  for  STIS  facts.  A fourth  function  provides 
for  the  updating  of  an  alert  indicator  to  facilitate  consistency  investigations 
when  historically  related  data  varies  in  an  unusual  or  suspicious  manner.  A 
fifth  function  provides  for  STIS  investigative  searches  heavily  conditioned 
by  credibility  considerations  because  of  the  use  of  fact  derivation  through 
inference  rules. 


All  of  these  functions  are  specified  at  the  functional  level  in 
the  sense  that  the  data  states  before  and  after  the  function  provide  the 
basis  of  description.  Specific  imp lenen tat ions  and  programming  languages 
are  not  examined.  All  the  functions  are  in  some  measure  subject  to  possible 
adaptations  and  variations. 

5.1  CREDIBILITY  COMPUTATION  (FIGURE  5-1) 

We  have  organised  the  pattern  of  computations  and  decisions  dis- 
cussed in  this  report  body  so  that  a view  may  be  had  of  their  general 
relationships  in  the  overall  information  plan.  Fig  5-l(a)  gives  this  picture 
for  the  raw  information  end  of  the  scale;  that  is,  from  the  original  reports 
to  the  system  facts  distilled  from  those  reports  under  the  appropriate  file 
authority.  Fig  5-1 (b)  provides  the  picture  at  the  more  distilled  end  of  the 
scale;  that  is,  from  the  system  facts  to  facts  that  are  inferred  from  the 
original  system  facts. 

In  both  Fig  5-1 (a)  and  Fig  5-l(b),  there  is  a division  into  "phase  A" 
and  "phase  B",  a result  of  considering  system  facts  of  a different  nature  and 
taking  a different  sort  of  processing.  Phase  A deals  with  system  facts  for 
which  the  credibility  concepts  of  this  report  are  applicable.  For  these 
facts  it  appears  useful  to  keep  track  of  a probability  estimate  (the  credi- 
bility) that  the  fact  is  true.  Technical  enq>loyment  facts  are  given  as  illus- 
trations in  the  figure.  Phase  B deals  with  system  facts  of  a numeric  nature,  in 
i^ich  it  appears  that  uncertainty  is  well  accounted  for  by  a statistical  method. 
For  these  facts  it  appears  useful  to  keep  track  of  a best  estimate  of  the  appro- 
priate mmeric  quantity,  and  of  its  typical  variability.  Missile  range  capabil- 
ity or  firing  activity  are  used  as  illustrations  in  the  Figure. 

5.2  GENERAL  INFORMATION  FLOW  (FIGURE  5-2) 

The  processors,  files,  and  personnel  for  the  information  processing 
are  indicated  in  Figure  5-2.  The  three  figures  together  are  a helpful  guide 
to  the  program  specifications  which  follow.  The  first  two  auiy  also  serve  to 
Illustrate  preceding  sectional  paragraphs  referenced  in  the  Figure. 
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THE  PROCESSORS 

V*  furnish  h«r«  a listing  of  functions  to  ba  parfonaad  by  tha 
processors  appearing  in  Fig  5-2.  It  is  not  fait  that  this  listing  is  exhaus- 
tive but  consists  asrsly  of  those  functions  asntionsd  in  the  text. 

A good  many  of  these  functions  appear  explicitly  in  Fig  5-1 (a)  and 
5-l(b).  Where  this  does  not  apply,  the  function  number  appears  in  parentheses, 
end  a reference  is  given. 

It  is  also  quite  possible  that  some  processors  will  hsve  subprocesrors 
or  will  consist  of  separate  system  Bxjdules.  No  attempt  is  sMde  to  resolve  such 
possibilities,  the  intent  being  to  clarify  program  specif ications. 

5.3.1  Keport  Update  Processor 

i;  Accept  likelihood  estimata  and  report  header  from  file 
authority  and  enter  on  report. 

2.  Accept  report  information  and  enter  in  report  file  in  log 
manner,  together  with  report  header  and  likelihood  estimata, 
and  computed  numeric  report  values. 

(j)  Modify  selected  report  headers  in  the  report  file  (paragraph 
4.3.4). 

5.3.2  Nat  Update  Processor 

1.  Accept  fact  credibility  or  likelihood  eatimate  end  feet 
identification  from  file  authority. 

2.  Update  fact  credibility,  performing  computation  and 
language  changes  between  likelihood  and  credibility* 

(3)  Update  fact  credibility  due  to  aging  conditions  (paragraph 
4.3.1,  4.3.2). 

4.  Compute  and  enter  elert  etetua  update  information  (Mete 
definiclone  below). 

5.  Accept  numeric  report  values  from  file  authority  (or 

from  report  update  proceaaor)  and  ntoMrle  fact  identification. 

4.  Compute  and  enter  updated  maseric  fact  ostimetes  (using  - 
S.  above) 
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(7)  Enter  sytten  infomition  eonstents,  such  as  alert 
threshhold  values  for  ttissile  activity  (paragraph  4.3.1.12). 

(8)  Initiate  and  teminate  systen  facts,  with  qualifying  data 
such  as  credibility,  time,  or  range  of  variability  paragraphs 
4.3.4). 

5.3.3  , Report  Search  Processor 

' 1.  Search  for  and  give  reports  bearing  on  a particular  area 
of  interest.  This  may  mean  searching  by  one  or  more 
%»ords  in  the  report  headers. 

5.3.4  Net  Search  Processor 

1.  Search  for  and  give  search  results  bearing  on  a particular 
area  of  inquiry.  This  may  aiean  searching  selected  portions 
of  the  normal  end  inverted  files  using  one  or  store  search 
words  for  search  comparison  purposes. 

2.  Search  for  results  using  logical  resolution  methods.  This 
may  be  accomplished  using  a separate  processing  module. 

5.4  DEFINITIONS  AND  NOTATION  ^ 

Ve  asscoible  here  some  important  definitions,  with  associated 
notation,  which  have  appeared  eerlier  In  the  report  body. 

(1)  "Credibility"  of  a fact  means  the  estimete  of  the  prob> 
ability  that  the  fact  is  true.  This  is  a single  number 
ranging  from  0 to  41,  which  la  subject  to  updating  as 
appropriate  reports  appear.  If  the  fact  is  UA(2,7) 

(person  #2  works  at  facility  #7),  than  ^A(2,7^  ■ .75 
assigns  a credibility  of  .75,  sometisMs  denoted  thus: 

.75,  WA(2,7). 

i 

(2)  "Credibility"  of  a rula  (i.a.,  a logical  implication)  means 
estimates  for  the  probability  that  the  conclusion  of  the 
rule  is  true  under  the  assumption  that  the  rule  antecedent 
facts  (i.a.,  hypothesis)  are  absolutely  assured.  These 

I 
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•r«  tyo  nmhmcM,  Mch  ranging  from  0 to  -fl,  one  prlnary 
nunber  giving  ths  probability  that  the  rule  conclusion 
is  true  if  the  antecedent  facts  are  true.  The  second, 
refining  nunber,  gives  the  probability  that  the  rule  con* 
elusion  is  true  if  the  hypothesis  is  false.  With 
definition  (1)  notation,  we  suppose  the  rule  is: 

HA(2,7)  A MW(2,3)->WA(3,7) 

where  we  have  introduced  as  one  of  the  antecedent  facts 
that  person  #2  works  with  parson  #3.  We  also  assume 
<«A(2,7t>  - .9 
<WW(2,3)>"  .8 

<»A(2,7)AWW(2,3^  - .9  X .8  - .72 
Our  procedure  goes  thus: 

<IA(3.7)>-  (.72X1.0)  + (l-.72)(.05) 

* .72  + .01  * .73 

where  the  two  rule  credibility  numbers  are  (.05,1.0). 

(3)  "Odds*'  of  a fact  means  the  ratio  of  the  credibility 
of  a fact  to  tha  credibility  of  its  negative.  With 
definition  (1)  notation: 

lC»(2.J)] - tff  ■ 3 

(4)  ’•Likelihood”  of  a report  R naans  the  ratio  of  tha  chances 
of  getting  tha  report  if  tha  associated  fact  is  true, 
divided  by  the  chances  of  getting  the  report  if  the  assoc- 
iated fact  is  false.  This  ia  a single  number,  generally 
not  leas  than  unity,  and  is  conceived  of  as  being  the 
essential  eatinata  made,  as  the  report  is  received,  bear- 
ing on  the  credibility  of  the  evidence  oarried  by  the 
report.  When  this  eatlante  is  effectively  made,  it 
naturally  incorporates  both  tha  discrlnination  quality  of 
the  report  and  the  degree  of  duplication  with  earlier 
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f*l*t*^  r«portt,  so  that  tome  knowledge  of  previous 
reports  is  Inherently  essentisl  in  the  estimation.  With 
definition  (1)  notation: 

meaning  that  under  the  current  reporting  environment » 
report  R is  twice  as  likely  to  have  been  received  in 
the  case  thot  the  relevant  fact  is  true. 

(5)  "Numeric  report  values"  are  nuna>ers  processed  from  a report 
which  present  the  report  Infomation  in  an  improved  or  con- 
densed manner.  For  example,  the  range  capacity  or  the 
timing  for  s stage  transition  swy  be  computed  from  a missile 
trajectory  report,  although  neither  was  originally  directly 
a part  of  the  report.  Such  reports  or  related  facts, 
where  measure  is  central  in  the  information  conveyed,  are 
referred  to  in  phase  B of  the  Fig  5-1  diagrams. 

(6)  "Alert  thrashhold  values"  are  presssigned  values  for  limits 
to  numeric  report  values  beyond  which  special  alert  status 
words  enable  special  information  explorations.  For  example, 
if  the  current  range  capability  estimate  or  the  current 
estiamtad  firing  activity  arc  outside  the  normal  operating 
Bone,  as  defined  by  the  threshhold  values,  then  this  in- 
formation is  posted  so  that  the  analyst  is  alert  to  the 
poasibility  of  exploring  information  to  interpret  the 
abnormality  in  the  operation  information. 

5.5  ICOPE  OF  PROGRAM  SPECIFICATIONS 

Na  aalact  those  functions  of  the  processors  that  appear  most  in- 
timately related  to  the  erea  of  credibility  and  consistency.  These  appear 
above  in  this  mannert 
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N«e  Update  Proccaaor 

2.  Update  fact  credibility,  performing  compute tlona  and 
language  changes  between  likelihood  and  credibility. 

0>  Update  fact  credibility  due  to  aging  conditions 
(paragraphs  4.3.1,  4.3.2). 

4.  Compute  and  enter  alert  status  update  information. 

6.  Compute  and  enter  updated  numeric  fact  estimates. 

Net  Search  Processor  . 

2.  Search  for  results  using  logical  resolution  methods. 
This  may  be  accoaiplished  using  a separate  processing 
■adule. 


These  five  functions  have  been  chosen  under  a broad  interpretation 
of  credibility  and  consistency.  For  example,  the  A. 4.  function  above  is 
related  to  the  consistency  of  a %dtole  group  (or  pattern)  of  facta  rather 

to  single  fact  consistency  problems.  (Likewise,  the  statistical  SMthod 
of  representing  uncertainty  or  credibility  ideas,  as  applied  to  the  appropriate 
facts,  referred  to  in  the  A. 6.  function,  is  a genaralisation  described  in  para- 


On  the  ether  hand,  the  functions  listed  in  paragraph  5.3.1  do  not 
appear  above  because  the  Impact  of  credibility  and  consistency  procedures 
is  slight.  In  the  case  of  a missile  trajectory  report,  obtaining  the 
range  capability  value  (one  of  the  numeric  report  values  of  the  second 
function  in  paragraph  5.3.1)  does  not  appear  to  be  affected  by  credibility 
procedures.  The  first  function  in  paragraph  5.3.1  may  or  may  not  have  the 
estimate  of  likelihood  as  part  of  the  report!  otherwise  this  function  also 
appears  to  be  unaffected. 

Thaae  five  functions  ore  detailed  in  the  following  paragraphs. 


CATIOW8  FOk 


ICH  PROCESSOR 


5.6.1 


Net  Updaf  Processor 


5. 6. 1.1 


Uodete  Fact  Credibility.  Performing  Computation  and 
i-anj^uette  ChanRes  between  Likelihood  end  Credjlblllty 


5. 6. 1.1.1  ynfonnetion  et  Start  of  Function 

(1)  X(F->R)  likelihood  estimate  is  evsilsble  tor  the 
evidence  of  report  R bearing  upon  fact  F. 

(2)  odds  estimate  is  available  for  fact 

F based  on  the  evidence  preccedlng  report  R. 


(3)  <F>  , . credibility  estimate  is  available  for  fact  F 
old 

bated  on  the  evidence  proceeding  report  R* 


5. 6. 1.1. 2 Information  at  End  of  Function 


(1)  1(F— >R)  likelihood  estimate  unchanged.  . 

(2)  L(F)  replaces  L(F)^, . and  report  R is  included 

new  old 

in  the  fact  F evidence. 

(3)  ^^new  ^•Pl*®**  ^**^id  included 

in  the  fact  F evidence. 


5. 6. 1.1. 3 Processing  in  the  Function  • 


(1) 

Compute  " ^^^oid  **(*‘“’^*^) 

(2) 

Compute 

(3) 

Store  L(F)^^ 

w 


M 


5. 6. 1.1. 4 Initiation  of  the  General  Proeeaa 

t (1)  At  some  point,  perhaps  with  the  first  report,  an 

■ ^^^^old  therefore  estimate  siust  be  siade 

* ' to  start  the  process  goina;.  Care  is  required  to 

i make  sure  that  no  report's  evidence  is  overlooked, 

I or  counted  twice. 


(2)  At  any  point,  especially  when  the  evidence  of  old 
reports  is  better  understood  by  tha  file  authority, 

Che  file  UDgiji  ^>old  *f*Pl*«»<*  '»y 

improved  values.  TThis,  in  effect,  reinitiates  the 
process,  and  later  reports  may  be  created  routinely. 


5. 6. 1.2.1  Information  at  Start  of  Function 

(1)  D^,  system  credibility  depreciation  constant  for 

this  type  fact  during  a review  period  without  reports. 

(2)  C , terminal  credibility  estimate  for  this  type  fact 

o 

through  many  review  periods  without  reports. 

(3)  credibility  estimate  for  fact  F at  start  of 
raportlass  review  period. 


(4)  1(F)  - . odds  estimate  for  fact  F at  atart  of 
Ol4 

review  period  without  reports. 


(1)  and  constants  unchanged 
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(2)  replace!  <r:>j^ 

^^*^>old 


'new  l-<r>. 


5. 6.1. 2. 3 Procestlne  In  the  Tunctlpn 


(1)  Compute  ^ ^^\ld  * 


(2)  Compute  L(F) 


new  1- 


(3)  Store  end  L(F)^ 


5. 6. 1.2.4  Inltletlen  of  the  General  ProceM 


(1)  At  any  point,  eepecially  when  the  pattern  of  evidence, 
and  gape  in  report!,  arebetter  underatood  by  the  file 
authority,  the  file  replaced  by 

Improved  valuea.  Thia,  in  effect,  reinitiate!  the 
proceaa,  and  later  aging  conditions  may  be  treated 
routinely. 

5.6.1. 3 Compute  and  Enter  Alert  Status  Update  Information 
5. 6.1. 3.1  Information  at  Start  of  Function 

(1)  A , 1«  available  as  alert  indicator  value  prior 

i(old)  ^ . 

to  receipt  of  new  estimate  of  parameter  (e.g., 

current  range  capability  estimate  for  missile  site 
#17) 

(2)  D is  available  as  new  estimate  of  parameter  D. 

' ' new 


M) 


lilable  as  normal  parameter 


Ymlue,  and  normal  parameter  tolerance  estimate. 


D 


5. 6. 1.3. 2 Information  at  End  of  Function 


I 

I 

i 

^ i 

I 

I 

1 

I 

i 

i 


'^l(new)  "Pl**^**  \(old)  Indicator 

value  la  based  on  the  current  estimate  of  the 

parameter  D. 

(2)  D is  unchanged. 

' ' new 

(3)  D and  d are  unchanged. 

' ' nor  nor 

5.6. 1.3. 3 Processing  In  the  Function 

(1)  CCTiyut.  - l°->»  - °n°r.L 

“nor 

(2)  Stor. 

5. 6. 1.3. A Initiation  of  the  General  Process 

(1)  As  soon  as  system  information  on  parameter  D 

makes  estimates  for  D and  d possible 

nor  nor 

and  profitable,  the  process  can  be  started  with 

the  current  estimate, 

new 

(2)  At  any  point  where  improved  knowledge  warrants, 

imnroved  D and  d estimates  may  be  em- 
^ nor  nor 

ployed.  The  process  is  undisturbed. 

5. 6. 1.4  Compute  and  Enter  Undated  Numeric  Fact  Estimates 
5. 6. 1.4.1  Information  at  Start  of  Function 


D is  available  as  a new  reported  value  for 
rep 

the  perameter  D (e.g.,  range  capability  for 
missile  site  #17). 


D and  d are  evailable  as  running  estl- 
old  old 

mates  before  receipt  of  of  the  value  and 

deviation  for  parameter  D. 


I 


(3)  ^Is  avallAbl*  a*  a ssoothing  or  woichclng  con* 
atane,  aubjecc  to  InforMCion  condlclona  and 
operator  JudgMne. 

. 5. 6.1. 4. 2 Tnforwatlon  at  tnd  of  Function 

(1)  D and  d roplaecs  D , . and  d , . as  the 
new  new  old  old 

affect  of  the  D_  value  ia  incorporated, 
rep 

^rep  and  arc  unchanged. 


! 

( 


j 


5. 6. 1.4. 3 Procesalng  In  the  Function 

(1)  C<»pute  - (1-  oO 

(2)  Coapute: 

'«.  * / «-•<> 

(3)  ftor.  and  d^ 

5. 6. 1.4. 4 Initiation  of  the  General  Froceaa 

(1)  A pralialnary  pair  of  aatiaates,  before  receipt 

of  D values,  or  shortly  after,  aav  be  ea* 

>fop 

ployed  for  initial  d^^d  ^*^'**** 

(2)  Zneraased  axperienca  aay  readily  lead  to  aodi- 
fieation  of  e<  paraacter. 

3.6.2  Met  Search  Processor 

3. 6. 2.1  gearch  for  Kesults  Usine  Logical  Resolution  Methods 

Ibis  aay  be  acceaplished  using  a aeparate  processing  aodulo. 


5. 6. 2.1.1  Information  at  Start  and  at  End  of  Function 


(1)  <p>t  P is  available  aa  fact  p with  current 
credibility  estimate  <p>. 

(2)  <q>,  q Is  available  as  fact  q with  current 
credibility  estimate  <q>. 


(3)  (<r->,  <r+>)  pAq:^  r is  available  as  rule 

yielding  derived  fact  r.  <r*>  and  <r4>>  are 
the  credibility  estimates  for  fact  r In  case 
the  rule  hypothesis  Is  false  or  true,  respec- 
tively. 


5.6. 2.1. 2  Processing  in  the  Function 


(1)  Compute  <r>  ■ <r->  (l-<p>  <q>)  + <r+>  (<p>  <q>) 

(2)  Prepare  <r>,  r for  display  to  operator 


5. 6. 2. 1.3  Display  of  Search  Results 


(1)  Search  result  <r>,  r where  r is  a derived  fact 
and  <r>  its  credibility  estimate. 


(2)  Background  data  of  paragraph  5. 6. 2. 1.1 

5.6. 2.1. 3  Initiation  of  the  General  Process 


Both  facts  p and  q are  apt  to  be  obtained  as 
the  result  of  a search  and  comparison  operation 
in  which  credibility  and  consistency  structures 
are  insignificant.  An  illustration  appears  in 
paragraphs  4.2.2  and  4.2.3. 

Such  rules  may  be  applied  consecutively,  under 
analyst  control,  as  illustrated  in  above  men- 
tioned paragraphs. 

(The  reverse  of  this  page  is  blank) 
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6.1 


LISP  HDDIFICATIOIIS 


Tht  LISP  laatuag*  mgsMtad  Itaclf  «a  a comranlant  tool  for  the  apec- 
iflcatlon,  daalgn,  and  laplaaeatation  of  inforaatlon  atrxicturc  aanlpulatlon 
tachnlquaa  aaaoclatad  with  intalllganea  Inforaation.  It  would  allow  for  the 
rapid  developacnt  of  Infarance  stratagiaa  and  credibility  analysis  techniques 
based  on  different  infomation  structures. 

Although  the  LISP  language  structure  is  sufficient,  certain  defici- 
encies existed  in  the  LISP  processor  available  for  the  unVAC  1110  system  at 
FTD.  These  deficiencies  would  Unit  the  accomodation  of  the  expected  range 
of  data  access  requireaents  for  the  intelligence  systan  at  TTD.  The  wain 
areas  requiring  investigation  can  be  sunaariaad  as  follows: 

(1)  The  transparent  transfer  of  ''pages’*  of  in-process  list  structures 
between  core  and  aass  storage  in  order  to  increase  the  aaount  of 
list  structure  that  can  be  accoonodated  in  a given  working  stor- 
age area, 

(2)  The  transfer  and  restructuring  of  cooplete  information  modules 
between  core  and  permanent  mass  storage  in  order  to  efficiently 
utilise  blocks  of  aass  storage  and  provide  for  an  on-going  data 
base  common  to  a group  of  users, 


\ (3)  Coasninlcation  between  LISP  and  non-LISP  program  modules, 

t 


The  investigation  and  subsequent  Bodificetions  to  the  1100  LISP  sys- 
ten  were  oriented  toward  producing  a new  tool  to  be  utilised  in  a complex  and 
hlgh-voluaw  data  base  environment.  The  modifications  preserve  the  LISP  lang- 
uage processing  integrity  wherever  possible  and  are  considered  to  be  generally 
useful  outside  of  the  STIS  environment. 


6.2.1 


So f tware  Pagit 


In  order  to  reduce  the  real  memory  requireawnts  placed  on  the  FTD 
1110  computer  by  a LISP  system,  the  concept  of  a paging  environment  was  ex- 
amined and  implemented. 

The  most  pervasive  modifications  to  UNIVAC  1100  LISP  is  the  Inclusion 
of  the  paging  environment.  Basically,  this  paging  environment  allows  the  user 
a virtual  reference  space  of  131K  while  the  real  core  allocated  him  is  only  a 
fraction  of  this  figure.  All  pointers  and  references  in  the  LISP  system  are 
made  with  vlrtiial  addresses  which  require  translation  to  real  addresses.  Both 
virtual  and  real  space  are  divided  up  into  equal-slsed  sections  called  blocks; 
these  blocks  correspond  to  the  LISP  notion  of  page  in  that  only  one  node  type 
may  reside  on  a block.  Virtual  blocks  can  be  in  one  of  three  states: 

(1)  Available  - Block  has  not  been  requested  by  LISP. 

(2)  Core  Resident  - Block  has  been  requested  by  LISP  and  has 
been  assigned  a core  block. 

(3)  Drum  Resident  - Block  has  been  core  resident  at  one  point, 
but  has  relinquished  its  core  block  for  use  by  another 
virtual  block.  It  now  resides  on  a drum  file  assigned  to 
the  LISP  system. 

Core  blocks  are  either  1)  allocated  to  a virtual  block  or,  2)  available  for 
assignment.  To  keep  track  of  the  various  blocks'  states,  there  are  four  data 


structures: 


(1)  Available  Virtual  Block  Queue 

(2)  Available  D-Bank  Core  Block  Queue 

(3)  Available  1-Bank  Core  Block  Queue 

(4)  Page  Table  - This  structure  also  records  each  virtual  block's 
node  type  and,  if  the  virtual  block  is  core  resident,  the 
core  block  assigned  it. 


10^ 


Each  virtual  block  has  a unique  place  for  itself  in  the  drum  file. 

If  s is  the  nu^er  of  sectors  that  can  store  one  block,  then  virtual  block  0 
occupies  the  first  s sectors  of  the  file,  virtual  block  1 occupies  the  second 
s sectors  of  the  file  and  so  on,  thus,  the  drum  file  may  be  thought  of  as  a 
■ replica  of  the  virtual  space. 

s 

When  LISP  requests  a virtual  block  for  which  no  core  block  is  avail* 
y able,  another  virtual  block  is  chosen  to  become  drum  resident  to  free  a core 

block.  This  choice  is  made  using  the  Least  Recently  Used  (LRU)  Algorithm  dis- 
cussed in  Appendix  C.  With  the  LRU  Algorithm,  the  virtual  block  which  was 
referenced  the  longest  ime  ago  is  the  one  selected  to  reside  on  the  durm.  The 
LRU  Algorithm  was  used  instead  of  the  Weighting  Algorithm  (described  in  Appendix 
I F)  primarily  for  its  speed  In  processing  each  virtual  reference  and  for  its 
I simplicity  of  Implcawntatlon. 
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Certain  virtual  .blocks  are  "locked"  into  core  (i.e.  once  requested 
they  must  always  remain  core  resident).  Most  of  these  virtual  blocks  are  also 
"fixed"  in  core.  In  this  case,  the  virtual  block  and  its  assigned  core  block 
have  the  same  number  so  that  all  virtual  addresses  in  the  virtual  block  are 
identical  to  their  real  addresses.  The  virtual  blocks  containing  system  code 
and  data,  system  atomic  syiri>ols,  and  register  space  are  all  fixed  and  locked 
to  greatly  reduce  the  number  of  reference  translations  in  the  system.  Virtual 
blocks  containging  compiled  LISP  code  are  defined  to  be  locked  to  maintain 
execution  efficiency  due  to  the  probable  high  number  of  references  to  compiled 
functions  within  STIS.  However,  compiled  code  blocks  need  not  be  locked  and 
swy  be  defined  to  be  pegeable  if  it  is  seen  that  there  is  little  activity  in 
these  functions. 

All  of  the  system  functions  were  amended  to  accommodate  the  paging 
environment.  These  changes  ere  transparent  to  the  user  except  for  functions 
such  as  *EXAM  which  now  use  virtual  addresses  as  arguments.  Also,  a garbage 
collection  is  now  performed  automatically  when  either  1)  no  available  virtual 
blocks  exist  when  one  is  needed  or  2)  no  available  I-Bank  core  blocks  exist 
when  one  is  requested. 

A subroutine  TRAPPER  was  written  to  perform  the  following  functions: 

(1)  translate  a virtual  address  to  a real  address 
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(2)  oparat*  the  LRU  algorltha 

(3)  writ#  a block  onto  tha  dria  211a 

(4)  raad  a block  fro*  the  dria  file,  and 

(5)  kaap  count  of  tha  nuabar  of  raada  and  wrltat  to  tha  drum  file. 

routlna  is  callad  within  tha  spataa  coda  whenever  a data  itaa  la  read  from 
or  written  to  a virtual  addraaa.  A aodifled  varalon  of  thla  routine  was  written 
aspaclally  for  use  by  coapllad  code.  The  LISP  compiler  was  then  modified  to 
output  the  calls  to  this  routine  In  the  appropriate  code  generation  functions. 

The  compiler  was  also  modified  to  generate  instructions  only  with  virtual  address 
fields. 

6.2.2  Permanent  Storage  Facilities 

Tha  usage  of  LISP  In  a large  data  base  context  requires  that  a facile 
Ity  exist  to  provide  for  the  "permanent"  storage  of  completed  list  structures, 
so  that  they  can  be  made  available  for  general  future  retrieval.  Such  a facil- 
ity requires  a mass  storage  I/O  and  allocation/deallocation  scheme  that  is 
considerably  more  elaborate.  In  the  long-term  development,  then  that  required 
for  te^orary  paging. 

The  LISP  system  has  been  modified  to  provide  facilities  for  the  stor- 
age,  and  subsequent  access  of  list  structures  in  a compressed  format  on  external 

mass  storage  files. 

A list  structure  to  be  output  onto  mass  storage  must  be  the  value  of 
an  atomic  syAol  identified  in  the  output  call.  Conversely,  a list  structure 
brought  in  from  mass  storage  becomes  the  value  of  an  atonic  symbol  identified 
in  the  input  call. 

To  provide  these  services,  three  functions  have  been  added  to  the 
LISP  repertoire t 

(1)  (PUTNODE  atomic  symbol  block  number  partition  id.) 

The  value  of  the  specified  atonic  syhbol  is  output  to  the 
specified  block  location  in  the  specified  partition  (file). 
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Durint  output,  th*  list  structure  Is  converted  to 
printeble  fom  (i.e.,  to  sa  S-expresslon)  end  pecked 
Into  en  output  block  sres.  When  output  cherecters  ex- 
ceed the  cspsclty  of  the  output  eree,  enother  block  lo- 
cetion  on  external  storage  is  allocated,  the  allocated 
block  number  is  placed  as  a link  in  the  last  word  of  the 
output  area,  and  the  output  area  is  written  to  the  cur- 
rently specified  block  location.  The  newly-allocated 
block  becomes  the  currently  specified  block  location, 
and  packing  of  output  characters  cosmtences  at  the  begin- 
ning of  the  output  area.  This  process  continues  until 
the  list  structure  is  exhausted,  at  which  time  the  current 
contents  of  the  output  area  are  written  to  the  currently 
specified  block  location  on  external  storage. 

(2)  (CETHODE  atomic  sy^ol  block  number  partition  id.) 

Data  (in  S-expression  form)  are  reed  beginning  at  the 
specified  block  location  on  external  storage,  into  an 
input  block  a^ea  and  translated  into  an  internal  list 
structure  using  existing  LISP  read  functions.  If  data 
in  the  current  block  are  exhausted  before  the  list 
structure  is  completed,  the  block  number  of  the  next 
block  on  external  storage  containing  continuation  data 
is  obtained  from  the  link  word  in  the  current  block. 

Blocks  are  read  as  required  until  the  entire  8-expresslon 
has  been  processed  and  the  list  structure  has  been  complet- 
ed. The  resulting  list  structure  is  assigned  as  the  value 
of  the  specified  atomic  symbol.  A list  of  any  link  blocks 
(continuation  blocks)  encountered  during  the  processing 
of  the  S-expression  is  assigned  to  the  system  atomic  sym- 
bol SECLZST.  (This  list  would  be  required  for  future 
"replace”  and  "release"  operations). 

(3)  (ALLOCATE  I Blocks  required  partition  id.) 
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The  specified  number  of  consecutive  blocks  of  external 
storage  is  reserved  for  subsequent  use  by  the  caller. 

The  allocate  function  is  used  for  the  acquisition  of 
unused  blocks  for  the  initial  output  of  internal  lists, 
and  is  also  used  (transparently  to  the  caller)  during 
PUmODE  processing  to  acquire  continuation  blocks.  The 
allocation  scheme  is  very  simple,  but  adequate  to  allow 
for  tha  building  and  debugging  of  higher-level  functions. 

It  is  anticipated  that  it  will  be  replaced  by  a more  complex 
allocation  algorithm  tailored  to  system  requirements  yet 
to  be  defined. 


6.2.3  Interface  for  LISP  Callers 

A facility  has  been  designed  to  allow  the  LISP  systam  to  be  called  by 
non-LZSP  programs.  The  calling  mechanism  provides  for  two  main  components: 
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(1)  th*  passing  to  LISP  of  an  S-axprassion  which  LISP  can 
awaluats  In  ths  norasl  way. 

(2)  tha  idantlflcatlon,  dascrlption  and  location  of  value 
paraaeters  which  arc  transforasd  from  LISP  to  non- 
LISP  foraat  or  vice-versa. 

A literal  in  the  calling  prograa  designated  as  the  LISP  S-expression 
is  transferred  by  the  interface  routine  to  the  LISP  read  buffer.  The  literal 
■ust  be  a cooplete  axpraasion  In  the  LISP  language.  The  expression  is  not 
scanned  by  the  interface  routine. 

Each  value  paraaetcr  associated  with  the  call  is  described  by  oteans 
of  a 2-word  packet.  This  packet  includes  the  following  Infomatlon: 

(1)  the  naae  of  tbi  paraaeter  - this  naae  is  interpreted  as 
the  atoalc  syabol  to  which  the  paraaeter  value  will  be 
attached  .(•ithcr  through  the  action  of  the  interface 
routine  or  tteough  the  evaluation  of  S-expression  by  LISP). 

(2)  Input/output  indicator  - indicates  whether  the  parameter 
value  is  aupplled  by  the  caller,  or  is  to  be  delivered  to 
the  caller  after  the  expression  is  evaluated. 

(3)  array  indicator  - indicates  whether  the  parsiaetcr  is  a 
single  value  or  a one-dlaensional  array. 

(4)  parameter  type  (c.g.,  integer,  double-precision  floating 
point) 

(5)  parasMtar  sise  - for  an  array,  the  number  of  elements;  for 
a string,  the  sise  in  words  (arrsys  of  strings  cannot  be 
defined). 

After  placing  the  S-axpression  into  the  LISP  read  buffer,  the  inter- 
face routine  examines  each  paramster  description  packet.  The  routine  assures 
that  an  atomic  symbol  having  the  naae  of  the  paraaeter  is  defined.  If  it  is 
an  output  parameter,  no  further  processing  of  it  takss  place  at  this  time.  If 
it  is  an  input  paraaatar,  the  parameter  value  is  placed  into  the  type  of  LISP 
space  appropriate  to  the  paraaeter  type.  If  an  input  array  is  being  processed, 
as  each  alaaant  is  assigned  LISP  space,  it  is  added  to  a LISP  list  structure. 

When  the  input  paraaeter  has  been  completaly  processed,  its  LISP  value  is  assigned 
to  the  appropriate  atomic  symbol. 


After  ell  peraaeccre  have  bean  procaaaed,  the  LISP  evaluation  process 
Is  entered. 

On  normal  return  from  LISP  evaluation,  the  Interface  routine  rescans 
the  parameter  description  packets  for  output  parameters.  For  each  output  para- 
meter, the  LISP  value  for  the  appropriate  atomic  symbol  is  retrieved  and  placed 
Into  the  specified  user  area.  During  this  processing,  appropriate  checks  are  made 
to  determine  that  the  LISP  value  types  correspond  to  those  given  In  the  output 
parasieter  description.  A LISP  list  must  correspond  to  a defined  array.  No 
change  is  made  to  LISP  values  during  this  processing. 

Error-free  processing  of  a user  call  results  In  a return  to  the  user 
with  a zero  status  word  (In  a location  specified  In  the  calling  sequence). 

Errors  occurring  during  parameter  processing,  or  during  evaluation,  result  In 
a return  to  the  caller  with  a non-zero  status  word. 

The  first  call  to  LISP  made  by  the  user  results  in  the  Initializing 
of  the  LISP  system. 

The  above  described  process  has  been  coded  and  tested.  Complete 
implementation  of  the  Interface,  however,  still  awaits  the  trapping  of  all 
possible  evaliiation  errors,  and  the  development  of  a contingency  processing 
strategy  suitable  for  the  destined  environment. 

6.2.4  LISP  Address  Space 

Currently,  LISP  is  oriented  toward  the  use  of  an  18-bit  (half  word) 
pointer,  of  which  only  17  bits  are  available  for  addressing.  This  address 
limit  of  131K  words  is  too  low  to  provide  for  complete  addressing  over  the 
whole  range  of  the  projected  STXS  data  base.  In  order  to  avoid  a requirement 
to  modify  LISP  in  this  regard  (though  the  modification  is  concaptually  simple. 

It  would  at  best  result  in  a considsrable  reduction  in  available  core  usage), 
it  has  been  decided  that  each  node  in  the  concept  net  will  be  a separate  list. 
Several  methods  are  available  for  dealing  with  these  lists;  the  method  that 
seeme  most  attractive  currently  is  to  treat  the  node  identification  as  an 
atomic  syhbol  and  to  list  tim  attribute  and  value  structure  of  the  STZS  Mode 
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from  the  atomic  aymbol.  Each  liat,  hance  each  node,  can  be  up  to  131K  words 
long.  Nodes  which  are  logically  larger  than  131K  words  can  be  segmented  by 
the  user  using  attributes  defined  for  that  purpose. 

Several  system  utility  functions  were  l^>lemented  %rlthln  LISP  to 
•help  the  programmer  control  the  free  apace  utilization  of  the  system. 

(1)  (REMOB  x)  - removes  all  atomic  symbols  In  the  list  x from 
the  hash  list  ao  that  they  are  eligible  for  garbage  collec- 
tion. 

(2)  (6C)  - allows  the  programmer  to  Invoke  the  garbage  collector 
to  restove  dead  space  and  place  It  on  the  appropriate  available 
free-apace  list. 

6.2.5  Data  Type  Double  Precision  Real 

A new  node  type  was  created  for  double  precision  reals.  Each  double 
precision  real  la  stored  as  a normallzad  double  precision  floating  point  number. 
Its  1/0  format  la  similar  to  single  precision  with  a 'D*  (In  place  of  an  '£') 
preceding  any  exponent.  A decimal  and  a 'D*  must  be  present  when  Inputting 
the  nuaber.  The  arithmetic  routines  were  modified  to  convert  argiasents  to 
double  precision  and  return  a double  precision  nusber  If  any  arguments  are 
double  precision.  The  following  was  also  Implemented: 

(1)  (7PCCMPRESS  DP)  - converts  the  double  precision  number  DP 
to  a single  precision  value  and  returns  that  value. 

The  Z/0  routines  which  perform  real  number  conversions  (BCD  to  binary 
and  vice-versa)  were  also  jjsproved  for  both  speed  and  accuracy. 

6.2.6  Other  Modifications 

Certain  additional  modifications  were  made  to  LISP  due  to  the  impact 
of  one  or  more  of  the  primary  Items  of  Investigation  mentioned  earlier  as  well 
as  tha  plannad  environment  within  which  LISP  would  function.  These  modifications 
include  the  following: 

(1)  Compiled  code  location  - (kimplled  code  has  baan  restricted 
to  occupying  Z-Bank  space  only. 

(2)  Dynamic  core  expansion  — The  LZSP  syatem  function  (CRON)  was 
removed  as  It  was  daemad  unnacessary  due  to  the  paging  Im- 
plementation. 


(3)  Control  Stack  ovarflov  - Tighter  security  measures  were  in- 
stalled to  detect  control  stack  overflows  into  any  contig- 
iously  collected  data  areas. 

(4)  Value  stack  placement  - The  placement  of  the  value  stack  and 
the  LISP  data  bank  (D-Bank)  in  general  was  made  Collector 
dependent  and  assembly  independent.  A relocatable  element 
of  LISP  can  have  its  starting  D-Bank  address  specified  by  a 
Collector  DBank  directive.  The  Collector  bank-naming  tech- 
nique is  now  used  to  create  an  absolute  element  of  LISP. 
Explicit  bank  collection  and  control  stack  overflow  traps 
allow  other  externally  assembled  modules  to  be  mapped  to- 
gether with  LISP  into  one  executable  element. 

c 

(5)  Timing  information  - (TIME)  and  GCTIME)  functions  were  modi- 
fied to  return  the  total  accumulated  SUP  (Standard  Unit  of 

' Processing)  time  for  the  LISP  session  and  for  garbage  collec- 

tions respectively. 

I The  control  card  :TIME  was  augmented  to  provide  the  total 

accumulated  SUP  time  for  the  session,  the  CPU  time,  the  I/O 
t time,  the  Executive  Request  time,  and  the  core  block  residency 

^ time. 


! 


f 


SUPPLEMENTARY  BIBLIOGRAPHY  ON  ASSOCIATIVE  PROCESSING 


Berra,  P.B. 
Davis,  E.H. 
DeFlore,  C. 

Feldman,  J. 

Kyburg,  H.E 
Lea,  R.M. : 

Minsky,  N. : 

Moulder,  R. 

Mute,  C.J.: 

Ozkarahan, 

Prentice,  B 

Rudolph,  J. 

Summers,  N.' 

Thurber,  K.. 


: Some  problems  in  associative  processor  applications  to  data 

base  management.  NCC.  1974.  1-5. 

STARAN  parallel  processor  system  software. 

NCC.  1974.  17-22. 

R.  and  P.B.  Berra:  A quantitative  analysis  of  the  utilization 

of  associative  memories  in  data  management.  IEEE  Trans  Computers. 
C-23.2  (Feb  1974).  121-133. 

D.  and  L.C.  Fulmer:  RADCAP-An  operational  parallel  processing 

facility.  NCC  1974.  7-15. 

. and  H.E.  Smokier:  Studies  in  Subjective  Probability.  Wyley,  1964. 

Information  processing  with  an  associative  parallel  orocessor. 
Computer.  Nov  1975.  25-32. 

Rotating  storage  devices  as  partially  associative  memories. 

FJCC  1972  (AFIPS  Vol  41).  587-95. 

An  implementation  of  a data  management  system  on  an  associative 
processor.  NCC  1973.  171-76. 

An  overview  of  a multi  associative  processor  study. 

ACM  Proc.  1974.  Vol.  1.  101-104. 

E. A. , ec.al.:  RAP  - An  associative  processor  for  data  base  management. 

NCC  1975.  379-87. 

.W. , et.al.:  Associative  Processor  Application  Study. 

RADC-TR-74-326  (Jan  1975)  , (A005308) . 

A.  et.al.:  The  coaming  of  age  of  the  associative  processor. 

Electronics.  Fsb.  15,  1971. 

An  Associative  Processor  Application  Study. 

BADC-TR-75-318  (Jan  19>6)  . (A021232K 

. and  L.D.  Wald:  Associative  and  parallel  processors.  ACM  Computing 

Surveys.  7.4  (Dec  1975).  215-53. 

Commuters  in  the  lB80*s.  Columbia  University  Press.,  1974 


Turn,  R. : 


BIBLIOGRAPHY 

Carnap,  Rudolf  and  Jeffrey,  Richard  C.,  Studies  In  Inductive  Logic  and  Probability. 
Vol.  1,  Unlv.  of  California  Press,  Berkeley,  Ca.,  1971. 

Duda,  R.O. • et  al,  "Subjective  Bayesian  Methods  for  Rule-Based  Inference  Systems." 
NCC,  June  1976. 

Flahaan,  Daniel  H.  at  al,  "MRFPS— An  Interactive  Refutation  Proof  Procedure 
System  for  Question  Answering,"  Unlv.  of  Maryland  Computer  Science 
Center,  College  Park,  Md.,  February  1933. 

Fishman,  Daniel  B.  et  al,  "The  Q*  Algorithm— A Search  Strategy  for  a Deductive 
Question-Answering  System,"  University  of  Maryland  Computer  Science 
Center,  College  Park,  Md.,  February  1973. 

Gettys,  Charles  F.,  and  Wlllke,  T.A. , "The  Application  of  Bayes*  Theorem 
When  the  True  Data  State  is  Uncertain,"  Oraanlaatlonal  Behavior  and 
Human  Performance.  4,  (1969)  pp  125-141. 

Goldhlrsh,  I.  and  R.  Carson:  "A  Deductive  System  for  Intelligence  Analysis" 
AAI-2255-TR-1,  April  1,  1976. 

f Johnson,  Edgar  M.,  "Numerical  Bonding  of  Qualitative  Expressions  of 

, Uncertainty,"  Army  Research  Institute  for  the  Behavioral  and  Social 

I Sciences,  Technical  Paper  250,  December  1973. 

Johnson,  Edgar  M. , "The  Effect  of  Data  Source  Reliability  on  Intuitive 
Inference,"  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences,  Technical  paper  251,  July  1974. 

Keuhner,  D.,  "Some  Special  Purpose  Resolution  Systems,"  Meltser  and  Mechle 
(eds.).  Machine  Intelligence.  Vol.  7,  Wiley  (1972),  pp  117-128. 

Kllng,  Rob.,  Fuaey  Planner— "Computing  Inexactness  In  a Procedural  Problem- 
Solving  Language,"  Technlcel  Report  No.  168,  February  1973. 

I Eowalskl,  R.,  "And-or  Graphs,  Theorem-proving  Graphs  end  Bi-directional 

Search."  Meltsar  and  MechAe  (eds.).  Machine  Intelllxence.  Vol.  7, 

Wiley  (1972),  pp  167-194. 

Kuhns,  J.L. , **Probablllty  Appraisals  Based  on  Possibly  Unreliable  Reports," 
£2e£at^gg_23^;teay[jJ[££j^  OSl  Technical  Mote  Mo.  9,  OS1:N73-004, 

I April  5,  1973. 

I Lee,  Richard  C.T. , **Fussy  Logic  end  the  Resolution  Principle,"  Jouryl  of  the 

I Association  for  Coroutine  Machinery.  Vol.  19,  Mo.  1,  January  1972, 

pp  109-119. 

LeFalvre,  Rick,  "Fussy:  A Programming  Language  for  Fussy  Problem-solving," 

I Matlonal  Technical  Information  Service.  PB-231  813,  January  1974. 

I 6-12 


f 


I 


I' 


t 


Xr< 


i 

{ 


BIBLIOGRAPHY  (Continu«d) 


L«vin«,  Jcrrold  M.  «od  Eldrcdgc,  Donald,  "EffeeC*  of  Ancillary  Znfomatlon  Upon  . 
Photolncarpratar  Parfomancc,"  Aroy  Research  InscltuCe  for  the  Behavioral 
and  Social  Sciences,  Technical  Paper  255,  September  1974. 

Sable,  J.,  "Design  Concept  for  an  Augmented  Relational  Intelligence  Analysis 
System  (ARIAS),"  AUER-2022-TR-2,  August  1973,  RADC-TR- 73-342 , (773189). 

Shapiro,  Bruce  A.,  "A  Survey  of  Problem  Solving  Languages  and  Systems," 

National  Science  Foundation,  Technical  Report  TR-235,  March,  1973. 

VanderBrug,  Gordon  J.,  and  Mlnker,  Jack,  "State-Space,  Problem-Reduction, 
and  Theorem  Proving— Some  Relationships,"  Communications  of  the  ACM. 

Vol.  18,  Mo.  2,  February  1975,  pp  107-115. 

Zadeh,  L.A.,  "Outline  of  a New  Approach  to  the  Analysis  of  Complex  Systems 

and  Decision  Processes,"  IEEE  Transactions.  Systems,  Man,  and  Cybernetics. 
Vol.  SMC-3,  Ho.  1,  January  1973,  pp  28-44. 


! 

I 


(The  reverse  of  this  page  Is  blank) 

6-13 


i 

I 

I 

i 


I 


A MODEL  POR  INTELLIGENCE  INFORMATION 


The  Concept  Net  represents  the  intelligence  anelysts'  collective 
view  of  the  current  state-of-af fairs  in  the  real  world.  It  is  populated  with 
^"facts'*  distilled  by  the  analyst  from  observations,  reports  of  observations,  and 
assertions  concerning  his  sphere  of  interest  in  that  world.  Since  it  is  a dy- 
namic world  and  viewed,  as  it  were,  "through  a glass,  darkly",  each  fact  has 
associated  with  it  an  open-ended  set  of  qualifying  statements  which  Include, 
typically,  the  source  (or  message)  from  which  it  was  derived,  its  Interval  of 
validity  (in  time  and/or  space),  the  date  of  observation  or  entry  into  the 
system,  the  credibility  (probabilistic  truth  value)  assigned  by  the  analyst, 
and  the  time-constant  (or  "half-life")  which  characterizes  the  volatility  of 
Che  information.  Because  virtually  all  intelligence  Information  is  both  of 
questionable  veracity  and  subject  to  change,  we  view  the  original  credibility 
level  as  being  modulated  by  an  e3q>onentially  decaying  weighting  function 
whose  time  constant  is  characteristic  of  the  volatility  of  the  type  of  infor- 
mation in  question.  For  example,  the  place  of  employment  of  an  individual 
may  have  a half-life  of  four  years.  That  is,  if  it  was  reported  in  1970  that 
. George  Murphy  worked  for  RCA,  and  this  "fact"  was  accepted  with  a credibility 
of  0.8,  then  in  1974,  in  the  absence  of  any  new  data  concerning  Mr.  Murphy, 

I the  credibility  of  that  fact  would  be  0.4. 


Another  characteristic  of  intelligence  information  is  that  there 
may  be  conflicting  reports  concerning  the  facts  about  a given  entity  and/or 
legitimately  differing  views  among  one  or  more  analysts  as  to  what  the  facts 
r«y  be,  or,  for  that  matter,  more  than  one  value  for  a given  attribute  may 
be  vmlid  in  a given  time  Interval.  (The  case  may  be  that  Mr.  Murphy,  while 
working  for  RCA,  moonlights  as  an  instructor  for  Rutgers  University  so  that 
apparently  conflicting  reports  on  Mr.  Murphy's  occupation  may  be  reconcilable, 
and  coexist  with  a high  credibility.  On  the  other  hand,  the  report  of  Mr.  Murphy's 
aaployment  at  Rutgers  may  be  a deliberate  plant  or  "cover"  to  obscure  the  fact 
that  be  worka  for  RCA.)  For  this  reason,  and  to  provide  for  simultaneous  use 
of  a coamon  body  of  information  among  many  analysts,  the  analyst  or  organization 
tdiich  ia  rasponsible  for  a given  "fact"  is  recorded  as  part  of  the  Infonwtion 
qualifying  that  fact. 

/ 
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THE  CONCEPT  NODE 


The  Concept  Net  is  organized  as  a network  of  nodes,  each  of  which 
represents  a concept  (such  as  an  individual  or  other  entity)  which  is  of  interest 
to  the  analyst.  The  node  in  turn  contains  a set  of  facts  (properties)  made  up 
of  attribute  names  and  qualified  values,  which  describe  the  entity  and  its  re- 
lationships to  other  entitles.  These  facts  are  derived  from  (and  tied  to) 
messages  concerning  observations  of  the  real-world.  Other  nodes  may  represent 
concepts  which  exist  independently  of  messages  (or  observations  of  the  world) 
such  as  semantic  concepts  representing  the  attributes  and  values  themselves, 
as  well  as  their  inter-relationships.  (Value  nodes  will  also  be  related  to 
the  entities  which  arc  described  by  (or  use)  those  values,  providing  a cross- 
index to  the  Entity  Net.) 

Each  node  in  the  Concept  Net  comprises  an  open-ended  set  of 
properties  of  the  concept  or  real-world  entity  which  is  represented  by  the 
node.  A property  is  an  attributc-name/attrlbute-value  pair  which  may,  in 
turn,  be  qualified  by  an  arbitrary  list  of  properties.  Attributes  and  values 
(also  terms  and  words)  are  themselves  represented  by  nodes  in  the  Concept  Net. 

An  entity  node  may  stand  for  a raal-world  Individual,  unit,  facility,  weapon, 
event,  etc.  A node  may  also  represent  a state  or  sub-entity  attached  to  a 
parent  node.  For  example,  a parent  node  may  represent  a generic  class  of 
weapons,  such  as  the  Minuteman  missile,  while  a sub-node  may  represent  a specific 
example  of  that  missile  installed  at  a particular  site,  with  a particular  target, 
etc. 

When  a given  entity  or  other  concept  node  (the  source)  bears 
some  relationship  to  another  concept  node  (the  target),  that  relationship  is 
represented  in  what  is  called  an  entity-relational  attribute  in  the  source  node. 
Its  value  is  the  identifier  (Node  #)  of  the  target  node.  In  order  to  provide 
complete  cross-referencing,  there  will  be  defined  for  each  relational  attribute 
K (using  its  Attribute  Node  in  the  Seuntic  Net)  an  Inverse  relation  so 
that  if  entity  a bears  relation  R to  entity  b "R(a  b)"  then  entity  b bears  re- 
lationship r"^  to  entity  £ ”R“^(b  a)”.  For  example,  if  the  Pershing  Missile 
has  a test  site  at  White  Sands  "Has  Test-site  (Pershing  Missile,  White  Sands)", 
then  White  Sands  is  the  test  site  of  the  Pershing  Missile  "Is  test-site  (White 
Sands,  Pershing  Missile)"  where  "Inverse  (has  test  site,  is  test  site)" 
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and  "Inverse  (Is  test  site,  has  test  site)".  In  the  above  example,  the  first 
ttio  statements  would  be  in  the  Entity  Net  (Pershing  Missile  and  White  Sands 
nodes,  respectively)  while  the  latter  two  statements  would  be  in  the  Semantic 
Net  (Has  test  site  and  Is  test  site  nodes,  respectively). 

In  addition  to  entity-relational  attributes,  an  entity  may 
possess  attributes  whose  values  are  names,  numbers,  or  descriptive  terms 
which  are  not  other  entities.  These  values  may  be  represented  by  nodes  in 
the  Semantic  Net  (rather  than  the  Entity  Net)  which  in  turn  cross  reference, 
as  entity  (or  index)  lists,  those  entitles  which  use  them.  Hence,  the  dis- 
tinction between  entity-relational  and  non-entlty-relational  attributes  has 
little  operational  significance  for  search  strategies  in  the  system.  In 
either  case,  the  entities  possessing  a given  property  are  accessible  through 
the  cross-referencing  (indexing)  feature,  whether  it  be  the  node  representing 
the  target  of  an  entity- relational  attribute  or  the  node  (in  the  Semantic  Net) 
representing  the  value  of  a non-entlty-relational  attribute.  The  entity  list 
under  the  value  node  can  be  considered  the  inverse  of  the  non-entity  relational 
attribute  in  the  entity  node  in  which  it  occurs.  The  Concept  Net  provides  for 
both  an  attributes-under-entity  (normal  file)  and  an  entities-under-attrlbute 
(inverted  file)  point  of  view.  This  redundancy  of  access  path  — sacrificing 
space  for  time  — is  built  by  the  system,  under  control  of  the  Data  Base 
Administrator  (who  may  limit  this  redundancy  selectively)  and  need  not  concern 
the  analyst  who  chooses  to  limit  his  role  to  that  of  an  Information  consumer. 


3. 


SUB-NODES  " COMPOSITE  ATTRIBUTES  AND  N-TUPLES 


There  will  be  Instences  In  the  Concept  Net  when  it  will  be  use- 
ful to  consider  one  node  as  subordinate  to  another  in  a hierarchic  sense  (rather 
than  the  non-hierarchic , or  coordinate,  relationship  between  two  nodes  which 
ere  Joined  by  an  entity-relational  attribute).  When  this  subordinate  relation- 
ship is  defined,  it  inplies  the  desirability  to  store  the  subordinate  node  so 
that  it  is  physically  accessible  with  the  parent  node,  reflecting  logical  de- 
pendency and/or  predictable  access  patterns.  When  this  occurs,  the  subordinate 
node  is  called  a sub-node  of  the  parent,  or  Baster,  node. 

The  sub-node  relationship  can  arise  in  several  contexts.  In 
addition  to  the  close  aaster/slave  relationship  that  nay  exist  between  two 
entities,  mentioned  above,  a subnode  nay  represent  what  is  called  a conposite 
attribute,  or  n-tuple.  A conposite  attribute  is  an  attribute  comprising  a 
set  (n-tuple)  of  sinpler  attributes.  For  example,  position  nay  be  defined  as 
a composite  attribute  comprising  the  simple  attributes  latitude  and  longitude, 
or  address  comprising  number . street,  city,  and  state.  Composite  attributes 
provide  for  generic  terms  which  conveniently  reference  and  retrieve  a set  of 
specific  information.  The  analyst  or  programmer  who  is  concerned  about  the 
structure  of  the  Concept  Met  or  is  developing  appropriate  terminology  for 
semantic  concepts  may  work  with  the  Data  Base  Administrator  to  define  composite 
attributes  or  other  sub-node  relationships. 
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{4.  FOR>L\L  DESCRIPTION  OF  THE  CONCEPT  NODE 

n Each  Concept  Node  in  the  STIS  Concept  Net  Is  represented  by 

^ the  same  formal  structure,  called  a description  list.  Entity  Nodes,  Attribute 

I ^ * Nodes,  and  Value  Nodes  are  all  Instances  of  Concept  Nodes  in  STIS.  Each  Con- 

; cept  Code  (or  Node  #)  is  the  name  of  a description  list.  (The  Node  0 will  be 

I used  as  a key  to  obtain  the  description  list  from  permanent  storage.)  Sub- 

• nodes  are  also  represented  by  description  lists  but  they  do  not  have  separate 

Concept  Codes  associated  with  them  since  they  are  stored  with  the  parent  node. 
A composite  value  (the  value  of  a composite  attribute)  is  a special  case  of  a 
sub-node  in  which  the  attributes  have  been  predefined. 

I 

I A Concept  Node  in  STIS  is  a description  list.  The  formal  syn- 

of  a description  list  is  specified  in  Table  A-1.  Lower  case  letters  repre- 
sent syntactic  variables  and  upper  case  letters  represent  concept  codes  or 
other  terminal  atomic  symbols. 

. There  is  no  syntactic  distinction  between  brackets  and  paren- 

\ theses.  Note  that  a description  list  is  defined  recursively  so  that  there 

I is  no  constraint  on  the  nesting  of  subnodes  representing  qualifiers  or  cora- 

I t posltc  values. 


TABLE  A-1 


MODE  STRUCTURE  SPECIFICATION 

N 


^ote;  The  convention  used  here  for  syntax  specification  uses  the  following 
•etallnguistic  symbols: 

A-  la  defined  as,  or  can  be  replaced  by 

^ j one  or  more  occurrences  of  the  expression  enclosed 

by  the  lower  half>bracket 

I choice  sjrmbol 

f ^ optional  (at  most  one  occurrence)  of  the  expression 

enclosed  by  the  upper  half-brackets 


Syntax 


desllst  ■«*  10  (.prop;] 
prop  (A  val) 
val  ♦ V 1 I (val;  1 
qual  (*  ^propjl 


(val  qual)  | desllst 


Semantics 


desllst  “ description  list 
prop  ■ property 

val  ■ value 

A ■ Attribute  Code  (l.c..  Node  #) 

V • Value  Code  (l.e..  Node  I),  numeral,  or  string 
representing  a terminal  value. 

qual  • qualification  list 

(V  ...]  • array  (list)  value 

(val  qual)  - a qualified  value;  qual  is  the  subnode  which 
qualifies  val 


,j.i«  nrnpmnmm  w' 


TABLE  A-1  (Continued) 


Exmplcs 

The  following  description  list  exaaples  represent  Entity  Nodes. 
In  the  interest  of  clsrity,  stti^ibute  and  value  names  are  used  rather  than 
Node  Numbers. 

#1  “ [9(Name  (9(First  Jerry)  (Last  Sable)]  ) (Age  (45  [*(Source  Est) 
(Accuracy  ± 3)  (Validity- interval  1975)])) 

(Vorks-at  #2) ] 


#2  ■ [9(Name  AAI)  (Fac-type  Consultant-org)  (Employs  [#1  #3  #4]) 
(Location  ([Phila  Wash]  [*(Cred  0.90]))] 


#3  ■ ([9(Namc  Schsrnacke)  (Works-at  #2)]  (*(A0R  Consultants)]) 


#4  ■ ([f(Name  HcCraa)  (Vorks-at (#2 [* (Validity- Interval  [1963  1975])]))] 
(*(A0R  Consultants)]) 
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5. 


THE  SEMANTIC  WET 


The  Semantic  Net  la  that  eubaet  of  the  Concept  Net  comprising 
Attribute  and  Value  Nodes.  All  attributes  and  values  are  represented  by  nodes 
in  the  SesMntlc  Net.  (In  the  case  of  numeric  values,  the  Value  Node  represents 
an  interval  on  a lograrichmlc  or  linear  scale.)  When  they  occur  In  the  descrip- 
tion list  of  a node  in  the  Entity  Net,  attributes  and  non-numeric  values  are 
represented  by  their  Concept  Codes  (Node  Numbers). 

5.1  Attribute  Nodes 

The  description  of  any  concept  consists  of  a list  of  properties, 
l.a.,  attribute  name/value  pairs.  Since  attributes  are  concepts  themselves, 
they  are  represented  by  nodes  in  the  Semantic  Net  subset  of  the  Concept  Net. 

Some  of  the  attributes  which  can  be  expected  to  be  used  in  the  description  list 
of  an  Attribute  Node  are  listed  below.  (It  should  be  noted  that  as  in  all  nodes, 
these  attributes,  except  when  they  are  self-referencing,  are  represented  by  the 
Node  Codes  of  Attribute  Nodes.  Their  values  are  represented  either  by  Node 
Codes  or  by  Term  Codes.) 


Attribute  name 

Synonym 

Narrower  attributes  (for  composite  attributes) 

Broader  attributes  (for  components  of  composite  attributes) 

Inverse  attribute  (for  Entity  Relational  attributes) 

Values  (the  list  of  values  for  this  attribute,  limited  to  the 
first  dosMin  element  in  the  case  of  Entity  Relational 
attributes) 

Attribute  Data  Information  — the  value  of  this  attribute  is 
a pointer  to  the  Attribute  Data  Record  in  a Direct 
Access  file  outside  of  the  Concept  Net.  The  ADR  de- 
fines the  format,  precision,  units,  and  "owner"  of 
the  attribute.  This  is  an  example  of  a special  attri- 
bute, or  Frocass  Hook,  which  invokes  an  outside  routine 
to  compute  a complex  value,  using  the  nominal  attribute 
value  as  a parameter. 

Other  Attribute  properties,  such  as  transitivity,  raflexlvlty, 
and  ay  I try  Which  may  exist  will  also  be  rapresantad  in  the  property  list  of 
the  Attribute  Mode. 


A-t 


•r.  !*  »;'• 


5.2 


Value  Nodes 


Each  non-numeric  value,  or  range  of  numeric  values,  which  can 
serve  as  a retrieval  condition  will  be  represented  as  a Value  Node  In  the 
'Concept  Net.  When  Indicated  by  the  analyst,  or  Data  Administrator,  the  Value 
Node  will  serve  as  the  head  of  an  Index  to  Information  In  the  Entity  Net. 

This  provides  support  for  the  three  basic  strategies  for  retrieving  Informa- 
tion about  Intelligence  entitles: 

(1)  through  the  context  of  an  explicitly  Identified 
entity.  Including  Its  association  with  other 
entitles  via  relational  attributes, 

(2)  through  a retrieval  criterion  made  up  of  a set 
of  specified  properties  which  the  entity  should 
possess,  and 

(3)  through  properties  which  are  plausible  for  the 
entity  because  they  can  be  Inferred  from  general- 
ised rules  stored  In  the  Concept  Net. 

Some  of  the  attributes  which  can  be  expected  to  be  used  In  the 
description  list  of  a Value  Node  are  listed  oelow: 

Value  name 

Synonyms 

Narrower  values  (or  subsets) 

Broader  values  (or  supersets) 

Attribute  (the  attribute  that  has  this  node  as  a value,  the  In- 
verse of  the  Values  attribute  in  the  Attribute  Node) 

Entities  (the  entities  %rhich  have  this  node  as  a value.  This 
serves  as  the  Index  list  for  those  entities.) 


I 


6. 


THE  ENTITY  WET 


Information  about  any  Intelligence  entity  of  concern  to  the 
I analyat  can  be  stored  In  STIS  by  creating  an  Entity  Node  to  represent  It  in 

the  Concept  Met.  Once  the  node  is  created,  the  description  of  the  entity  is 
stored  as  a list  of  properties.  Internally,  the  entity  is  known  by  its  Node 
Nu^er,  which  serves  as  its  retrieval  key  from  permanent  storage,  as  is  the 
case  for  any  node  in  the  Concept  Net.  In  its  simplest  form,  the  entity 
number  n is  represented  by  a description  list  such  as: 

n - [9  (A  a)  (B  b)  (C  c)  ...] 

The  interpretation  is  that  the  entity  represented  by  node  n has  all  of  the 
properties  listed.  That  is,  in  conventional  relational  or  logical  format, 
the  attributes  A,  B,  C,  ...  are  binary  relations  connecting  the  entity  and 
a value  and  the  following  conjunction  holds: 


A(n,a)  A B(n,b)  A C(n,c)  A ... 

Thus,  in  the  Entity  Net,  information  is  collected  in  an  “attri- 
butes-under-entlty"  format,  while  in  the  Semantic  Net,  one  may  say  that  Che 
same  Information  appears  in  an  "entities-under-attribute"  format.  As  will  be 
discussed  below,  the  simple  description  list  form  can  be  generalized  in  a 
number  of  important  ways. 


6.1 


The  simplest  relations  are  attributes  which  take  scalar  values, 
either  literal  or  numeric,  such  as  Name(n, Atlas)  and  Weight (n, ISO) . However, 
values  are  generalised  to  permit  arrays,  such  as  Name(n, [Atlas, M12])  and 
Locacion(n, [ND,FL]).  Assuming  Node  n is  110,  this  would  appear  in  description 
list  fprmat  as: 

110  - [9(Mame  (Atlas  M12])  (Weight  150)  (Location  [ND  FL])  ] 


EntlCy-relaclonal  attributes  n^-'ie  other  Entity  Nodes  as  values. 

If  entities  #11  and  #12  were  test  sites  for  #10,  then  the  update  command  "Add 
Test-Site  (#10,  (#11,  #12))"  would  add  the  property  (Test-Site  (#11  #12))  to 
the  description  list  for  #10. 

By  permitting  a value  to  be  represented  by  a description  list, 
or  subnode,  the  descriptive  power  of  the  system  is  augmented  in  a number  of 
ways.  The  simplest  instance  of  this,  the  composite  attribute,  was  described 
in  Section  3.  Other  cases  will  be  discussed  In  the  following  paragraphs. 

6.2  Generic  Entities 

It  is  often  useful  to  describe  an  object  as  a generic  type  for 
which,  in  the  real  world,  there  exists  a number  of  specific  occurrences.  This 
can  be  done  by  creating  a node.  Called  a generic  entity,  which  represents  the 
common  characteristics  for  these  objects.  This  can  then  be  supplemented  by  a 
node  for  each  individual  object  for  which  specific  information  is  required  but 
which  is  not  characteristic  of  the  class  as  a whole.  For  example,  suppose  we 
have  the  missile  type  Atlas  represented  by: 

#20  - (^(System  ICBM)  (Name  Atlas)  (Weight  150) 

(Accuracy  3)  (Instances  (#21  #22  #23))  ] 

Nodes  #21,  #22,  and  #23  then  are  specific  entitles  whose  general  characteristics 
are  given  in  node  #20  and  therefore  may  be  Inferred  by  reference  and  need  not 
be  explicitly  repeated.  Each  Instance  will  reference  the  generic  entity  and 
give  only  unique  characteristics,  such  as: 

#21  ■ (^(Location  ND)  (Target  #31)  (Serial  1234)  (Generic-entity  #20)) 

Note  that  the  attributes  "Instances"  and  "Generic-entity"  are  a converse  pair. 

* 

6.3  Entity  States 

It  is  often  neceh.:ary  to  track  changes  in  a given  set  of  proper- 
ties of  a specific  object.  To  do  this,  subnodes  called  "states"  are  created. 


The  relationship  between  a specific  entity  and  a state  of  that  entity  is  paral- 
lel to  that  between  a generic  entity  and  a specific  entity.  That  is,  only  pro- 
perties whose  values  change  from  one  state  to  the  next  need  be  recorded.  In- 
varient  properties  are  given  in  the  parent  node.  For  example,  suppose  a Polaris 
type  submarine  is  being  tracked.  Intermittent  reports  of  its  location  may  be 
given  in  state  nodes  which  reference  the  specific  entity  node.  The  specific 
entity  node  may,  in  turn,  reference  a generic  entity.  This  interrelationship 
of  subnodes  is  diagrammed  in  Figure  A-1. 

The  recurring  motive  for  introducing  subnode  relationships  such 
as  "instance"  and  "state"  is  to  avoid  redundant  storage  of  information.  The 
payoff  for  eliminating  unnecessary  redundancy  is  reduction  of  maintenance  and 
retrieval  time  as  well  as  space.  Storage  compression  at  the  state  level  can 
be  carried  to  a further  stage  when  changes  in  state  are  predictable  or  can  be 
represented  analytically  as  a function  of  time.  Opportunities  for  this  may 
exist  in  situations  such  as  when  a periodic  itinerary  for  a submarine  or  other 
ship  is  known,  or  when  a satellite  position  may  be  found  from  orbital  parameters 
rather  than  extrapolation  or  interpolation  of  tracking  data.  In  such  cases, 
state  nodes  may  be  replaced  by  compact  state-transition  information. 

6.4  Fact  Qualification 

It  is  possible  to  modify  or  qualify  information  by  appending 
a qualification  list  to  either  a description  list  (node  or  subnode)  or  a value. 
The  qualification  list  has  the  format  of  a description  list  so  that  the  two 
forms  are  respectively  (deslist  qual)  and  (val  qual)  where  the  second  element 
is  the  qualification  list.  Typically,  qualification  information  in  an  Entity 
Node  will  contain  fact  control  (access  control)  information  if  it  is  at 
the  node  level  and  fact  control  and/or  source,  credibility,  and  temporal  data 
at  the  value  level.  Because  information  may  be  obtained  from  several  sources 
and  may  be  varying  with  time,  multiple  values  will  be  common  in  the  Entity 
Met.  The  particular  values  which  are  valid  for  a given  analyst  at  a given 
tlaa  will  be  determined  on  the  basis  of  the  qualification  list. 

The  default  Interpretation  of  the  property  (A  v)  for  an  entity 
(••y  •)  le  that  tha  entity  has  the  value  v for  the  attribute  A.  In  symbols  A(e) 
■ V.  The  value  v may  either  be  a scalar  V or  an  array  [V...].  However,  there 
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■re  occasions  when  one  wants  Co  specify  a relational  operator  other  than  equality 
between  the  attribute  and  the  value.  Possible  relations  are  greater-than,  less- 
then,  not-equal,  approxlmatcly-equal , not-greatcr-than,  etc.  The  qualification 
list  is  also  the  mechanism  for  accomplishing  this,  with  the  exception  operator 
attribute  "Rel-op".  For  example,  Age(e)>60  would  be  given  as  (Age(401*(Rel-oii  >)];). 


6. 5 Computed  Values 

There  will  be  Instances  when  it  is  more  convenient  to  compute 
a value  for  a given  attribute  from  specified  parameters  rather  than  explicitly 
■tore  its  value.  This  will  be  especially  true  for  large  arrays  of  composite 
attributes.  For  example,  it  will  often  be  more  efficient  to  compute  the  posi- 
tion, velocity,  acceleration,  etc.  of  a missile  from  trajectory,  atmospheric 
and  vehicle  parameters  rather  Chan  store  explicit  values  with  the  required 
precision.  Even  where  analytic  computation  is  not  practical,  it  is  often 
■ore  efficient  to  store  values  in  large  dense  arrays  or  conventional  files 
(on  serial  or  random  access  storage)  and  provide  the  appropriate  file  name 
or  key  in  the  description  list.  Another  example  of  the  latter  situation  is 
the  Fact  Control  Information  required  for  most  entities  and  properties.  Be- 
cause this  data  can  be  readily  formatted  into  fixed  files,  it  may  be  more 
efficient  to  provide  a key  to  a Fact  Control  Data  File  in  the  qualification 
list  pertinent  to  Che  basic  information,  rather  than  provide  that  data  in 
description  list  format. 

This  capability  will  be  accomnodated  by  using  a special 
"Process-Hook”  ayi^ol  and  parameter  list  in  place  of  the  actual  value  in 
the  description  list.  The  retrieval  mechanism,  when  encountering  the  Process 
Book,  will  invoke  the  specified  program  and  supply  the  given  parameters.  The 
called  program  will  return  the  required  value. 

6.6  Quasi-transitive  Relationships 

The  use  of  entity  relational  attributes  in  the  description  of 
Che  various  objects  of  interest  to  the  analyst  results  In  a network  of  nodes 
la  which  lafotaation  la  highly  associated.  This  richness  of  association 
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permits  Information  to  be  retrieved  from  many  points  of  view  or  search  paths. 
Although  this  feature  is,  in  general,  desirable,  unless  special  precautions 
are  observed,  there  are  situations  in  which  it  can  lead  to  the  retrieval  of 
information  which  does  not  validly  meet  the  conditions  specified  by  the  In- 
terrogator. 

Consider,  for  example,  a situation  in  which  a weapon  platform 
(say  a fighter-bomber)  can  be  equipped  to  bear  either  of  two  types  of  arma- 
ment (say  torpedo  or  Incendiaries)  depending  upon  under  which  service  unit 
(aircraft  carrier  or  tactical  air  base)  it  is  employed.  A given  entity  re- 
lational attribute  (such  as  "uses")  may  be  used  to  enter  this  Information: 

iUses  (Carrier  Lexington,  F-11) 

Uses  (F-11,  torpedos) 


Uses  (TAC  Base  Charlie,  F-11) 
Uses  (F-11,  incendiaries) 


The  five  entities  would  then  be  Interconnected  with  the  "Uses"  relation  as 
shown  in  Figurr  A-2.  It  is  apparent  that  a request  for  armament  used  by  the 
Carrier  Lexington  (or  XAC  Base  Charlie)  may  come  up  with  the  erroneous  answer 
"incendiaries  and  torpedos".  The  fallacy  is  caused  by  what  can  be  called  a 
"connection  trap"  in  the  F-11  "hub"  of  the  network.  It  is  avoided  by  using 
one  or  both  of  the  following  devices: 

(1)  The  set  of  values  of  a multivalued  attribute  are 
qualified  to  Inform  the  system  that  only  one  of 
the  values  can  occur  in  each  Instance. 

(2)  A configuration  node  (or  subnode)  is  created  to 
describe  each  valid  configuration  of  properties. 

These  approaches  are  detailed  below. 

Since  an  attribute  may  have  an  array  as  a value,  we  can  have 
a property  such  as: 

(Armament  [torpedo  incendiary]) 


in  the  description  list  for  an  entity  (say  F-11).  This  raises  the  question  as 


A-IS 


Carrier 

Xiaxlngton 


Torpedo 


lAC-Baac 

Charlie 


Incendiary 


rifure  a-2 
CeaneetloB  Trap 


to  the  Interpretation  of  the  array: 


V - t V2  ...  J 

when  it  occurs  as  a value.  The  members  may  be  an  ordered  n-tuple,  an 
(unordered)  set,  a bag  (unordered  set  in  which  repetitions  are  permitted),  a 
disjunctive  set  (any  subset  is  valid),  a conjunctive  set  (all  values  co-occur), 
or  a choice  set  (only  one  value  is  valid  in  each  instance).  The  type  of  set 
tdiich  is  intended  can  be  Identified  by  using  the  attribute  "Set-type"  in  a 
qualification  list  for  the  value.  For  example: 

(Armament  ([torpedo  incendiary]  [*  (set-type  choice)  ])  ) 

The  use  of  the  "Set-type  choice"  qualifier  alerts  the  system 
(and  the  user)  that  only  one  value  is  valid  but  in  itself  is  not  sufficient 
to  specify  which  is  the  valid  value  in  a specific  case.  This  problem  can  be 
solved  by  using  a subnode  (or  a state)  of  the  entity  to  establish  a description 
of  each  configuration  of  the  parent  entity.  For  example,  we  can  have  the  states 

[9(Used-by  Carrler-Lexington)  (Armament  torpedo)  ] 
and 

(9(Used-by  TAC  Base  Charlie)  (Armament  incendiary)  ] 

*******^  gtneric  entity  for  the  F-11.  Mote  that  this  second  approach  avoids 
Che  multiple  values  attribute  and  is  sufficient  in  itself  to  unambiguously 
describe  the  situation. 

6.7  Footnotes 


The  analyst  entering  facts  into  the  Entity  Net  will  be  permitted 
to  qualify  any  value  (or  entity)  with  unformatted  comnents,  warnings,  or  other 
text.  He  simply  labels  this  text  (genetically  called  footnotes)  with  the  appro- 
priate attribute  (Comment,  Warning,  etc.)  and  enters  it  with  other  qualification 
inforsMtion.  Rather  Chan  store  unstructured  text  as  part  of  the  node,  a special 
use  will  be  made  of  Che  Process  Hook  capabilicy.  The  value  of  Che  specified 
accribuce  will  be  a poincer  co  Che  appropriace  record  in  an  excamal  Fooc  noce 
Pile.  The  foocnoce  will  be  reCriaved  aucomacically  wich  ocher  qualificacion  in- 
foriMCion  whenever  required. 

(The  reverse  of  this  page  is  blank) 
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THEORETICAL  FOUNDATIONS;  THE  PROBABILITIES  OF  CCTIPOUND  PROPOSITIONS 


1.  INTRODUCTION 


A basic  consideration  In  any  work  with  probabilities  (or  credibilities) 


of  statetaents  of  Inforisatlon  (or  rules)  Is  how  to  assign  a probability  to  a 
statement  derived  from  other  statements.  If  the  truth>values  of  X and  Y are 
always  0 and  1,  then  the  values  for  such  compound  propositions  as  Xa-i  Y or 
XaoY  are  clearly  defined  and  well  known.  But  when  the  range  of  truth  values 
opens  up  to  the  whole  Interval  from  0 to  1,  there  arises  a whole  spectrum  of 
possibilities  for  each  statement. 

This  paper  discusses  all  those  possibilities  In  order  to  put  Into 
proper  perspective  what  has  sometimes  been  given  very  brief  treatment  In  litera- 
ture on  the  subject.  Some  conaents  will  be  made  on  what  appears  to  be  a very 
popular  first  choice  of  approaches  to  the  subject.  It  will  also  be  seen  that 
the  second  choice,  which  is  usually  mentioned  briefly,  Is  not  the  only  alterna- 
tive, although  It  may  be  the  best. 

2.  THE  DOMAIN 

A function  of  n two-valued  variables  has  a domain  of  ^ discrete 
points,  which  can  ba  conveniently  thought  of  as  the  vertices  of  an  n-dlmenslonal 
orthotope  (square,  cube,  tassaract,  etc.).  The  range  of  the  fmctlon  may  be 
superimposed  as  one  more  dimension.  The  function  or  dependent  variable  may  also 
be  two-valuad,  but  la  not  naeassarlly  so.  An  axaaiple  of  a mixture  of  two-valued 
Inputs  with  multi-valued  outputs  is  the  ball-shaped  "curve"  showing  the  dis- 
tribution of  nuibars  of  "heads"  whan  n coins  are  tossed. 

The  admission  of  values  between  0 and  1 for  independent  variables 
literally  opens  up  a whole  new  world  of  possibilities.  The  domain  of  a function 
then  ineludea  the  whole  Interior  and  boundary  of  the  orthotope.  The  knowledge 
of  idiat  goes  on  at  the  vertices  has  been  thoroughly  Investigated  and  copiously 
doeuamnted  In  the  last  few  decades.  In  many  eases,  these  Isolated  values  suggest 
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what  way  happan  la  tha  raat  of  tba  dosain,  but  tbay  nevar  daflna  it  with 
eartaiaty.  Thla  will  ba  aaply  lllustratad  la  this  papar,  idtara  vary  dlffarant 
|(  fwctlooa  daflaad  ovar  tha  iatarlor  of  a aquara  will  bo  aaan  to  hava  Idantlcal 

affaeta  at  tba  eoraara,  and  of tan  around  tha  whola  parUMtar* 

Tba  aquara  to  ba  uaad  raprasanta  all  pairs  of  valuas  froa  0 to  1, 
Ineluaiva,  for  two  Torlablas,  x and  y.  la  tha  lllustratloas , this  aquara  is 
abown  aa  If  lying  flat,  as  la  Figura  0.  Vartleal  eoordinatas  rapraaont  valuaa 


Flgura  0.  Uniwarsa  of  Dlaeouraa 

of  tha  dapaadaat  varlabla  a.  Pianos  for  x ■ .1,  .2,  .3,  ate.  ara  shoun  to 
aaalat  tbraa>dl»aaalonal  ▼iauallaatlon.  Tha  planaa  ara  drawn  at  If  opaqua,  but 
tha  euba  or  othar  solid  containing  thaw  aa  tranaparant.  The  gra^t  ara  la 
affaet  eentlauoua  truth  tablaa  for  logical  oparatlcns  on  propoaltlona.  Capital 
lattara  will  ba  uaad  to  rapraaont  such  atatananta,  but  snail  lattara  rapraaont 
g|^g[£.  If  Z ■ f(Z,  T),  than  x raprasanta  tha  probability  that  X la  true,  y 
tha  probability  that  T la  trua  and  a tba  probability  that  tba  eenpowd  proposi- 
tion Z la  trua. 


1-2 


V 


3 


X A Y 


3.1  Ind«pAnd«nt 

Th«  first  function  to  bs  consldsred  is  Z ■ XA  Y.  If  X and  Y are 
independent,  the  value  assigned  to  the  probability  that  they  are  both  true 
is  the  product  of  the  individual  probabilities:  e • xy. 

This  is  represented  by  the  warped  surface  illustrated  in  Figure  1. 
The  lines  draun  in  the  surface  represent  its  intersection  with  the  planes 


Figure  1.  Probability  of  XAY 

X • .1,  X - .2,  ate.  In  this  ease  the  intarsaetions  happen  to  be  straight  lines. 
The  intersections  of  this  sasM  surface  with  horisontal  planes,  representing  con- 
stant values  of  a,  would  be  hyperbolas.  They  would  display  the  shape  of  the 
surface  the  way  contour  lines  do  on  a topographical  wee.  

The  indapandanea  of  X and  Y is  a vary  iatportant  ccnsidaration.  If 
the  Indian  height  of  a population  is  1,7  antars,  than  tha  atatanant  that  a ran- 
donly  salactad  sneibar  is  over  1.7  Mtars  tall  has  a probability  1/2  of  being 
true.  It  any  ba  that  tha  saan  population  is  equally  divided  between  tha  saxes. 


1-3 


But  the  steteaent 


(a  ie  tall)  A (a  la  aale) 

la  likely  to  be  true  for  laore  than  one  quarter  of  the  population.  And  the 
probability  of  a pair  of  atateaenta,  aach  1/2  true,  can  drop  quite  low,  e.g. 

(a  ia  aale) A (a  haa  ovariea). 

In  auch  eaaaa,  it  would  alwaya  be  helpful  (although  poaaibly  uneonatltutional) 
to  have  inforaation  that  diaeriainatea  on  all  aidea  of  aet  boundariea.  But  if 
the  only  inputa  available  are  the  probabilitiea  of  X and  Y,  then  the  probability 
of  Z ia  rather  uncertain.  In  the  eaae  where  x ■ y ■ 1/2,  it  rangea  all  the  way 
froa  0 to  1/2.  Can  it  ever  be  worae  than  that?  The  anawer  ia  given  in  Figurea 
2 and  3,  which  ahow  the  aaxiaua  poaaible  value  of  a and  the  ainiaum,  reapeetively. 

3.2  Maxlaua 

The  poaaible  probability  of  Z ■ X A Y ia 

a “ Bin  (x,  y). 

Ita  graph  in  Figure  2 is  two  planea,  aaeting  along  the  diagonal  of  the  cube 
where  x • y ■ a.  Thia  coineidea  with  the  graph  of  a • xy,  not  only 


•t  th*  four  eornors  of  the  square,  repreaencing  the  classical  truth  table,  but 
also  along  all  four  sides.  Thl^  shows  that  the  nlnimum  and  the  product  give 
Wentlcal  results  If  either  x or  y takes  on  a value  of  0 or  1,  If,  for  example 
X is  a tantology,  or  uaiversally  true  statement,  then  the  probability  of  X a Y 
la  simply  the  probability  of  Y,  as  shoun  by  the  diagonal  line  from  y > ■ - 0 
to  y • a ■ 1 in  the  front  face  of  the  cube. 

This  shows  vividly  that  for  the  propositional  calculus  both  multi- 
plication md  minimum  give  the  sane  results.  Either  xy  or  min  (x,  y)  gives 
the  truth-table  values  in  the  comers  of  the  square.  The  distinction  between 
them  is  meaningful  only  in  the  interior. 

3.3  Minimum 

The  third  function  to  be  graphed  in  connection  with  X A Y is  the 
minisum  possible  value  of  s.  The  probability  of  XA  Y increases  according 
to  how  much  the  stateawnts  X and  Y tend  to  apply  to  the  same  set  of  subjects. 
The  maximum  is  achieved  when  one  set  is  a subset  of  the  other.  Similarly,  low 
probabilities  arise  to  the  extent  that  the  characteristic  sets  of  X and  Y 
avoid  each  other.  If  x and  y are  on  the  low  side,  it  is  possible  for  the  sets 
to  be  disjoint,  and  then  the  probability  is  sero.  But  for  larger  probabilities 
the  sets  beeosM  so  large  that  they  cannot  help  overlapping.  If  they  still  stay 
as  far  away  from  each  other  as  possible,  the  territories  in  which 
arc  disjoint.  The  probability  then  achieved  is  x ->•  y - 1,  and  it 
if  and  only  if  x y > 1.  So  the  minimum  probability  of  X a Y Is 

max  (0,  X + y - 1). 

This  is  graphed  in  Figure  3,  where  it  is  seen  that  it  too  has  the 
as  the  other  two  graphs. 


^ ' 
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Figure  3.  Mlninuo  for  XAY 

3.4  COMPARISON 

The  three  grephe  are  ehown  together  In  Figure  4.  In  order  to  ehow 
all  three  surfaces,  the  picture  shows  the  planes  for  X ■ .1.  .2.  etc.  Each  one 


Figure  4.  Range  for  XAT 


•how*  the  range  of  a as  a parallelogram,  i4tleh  degenerates  to  a line  segment 
when  X ■ 0 or  .1.  The  product  xy  is  necessarily  between  the  maxlmun  and  the 
■Inlaua,  and  is  seen  in  Figure  4 as  a diagonal  of  each  parallelogram.  It  is 
not  gsnarally  midway  between  the  top  and  bottom,  but  it  represents  an  average 
of  all  waloas  weighted  by  their  probabilities  (assuming  X and  Y are  independent). 
For  example,  when  x and  y are  both  small,  the  characteristic  sets  of  X and  Y 
are  more  likely  than  not  to  be  disjoint.  So  the  graph  of  e • xy  stays  close 
to  the  floor  in  that  region,  not  up  near  the  roof. 

The  three  graphs  coincide  along  all  four  edges,  and  it  appears  as  if 
they  differ  from  each  other  increasingly  toward  the  center  where  x * y ■ 1/2. 

This  is  confirmed  in  Figure  5,  where  the  maximum  and  minimum  are  shoin  as 
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Figure  5.  Deviations  for  XAY 


deviations  above  or  below  the  product  xy.  This  is  accomplished  by  pushing  the 
eurved  aurfaee  down  to  the  floor  (a  ■ 0)  without  changing  sny  vertical  distances. 
Each  parallalogram  "racks"  to  a now  shape;  it  is  still  a parallelogram,  but  its 
diagonal  is  horisontal. 
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A satisfying  featura  of  Flgurs  5 is  that  it  shows  the  for 

a Just  as  far  below  xy  as  the  maxlBsnn  is  above  xy,  but  distributed  differently. 
The  parabolic  ridges  and  the  "tents"  they  subtend  are  congruent , but  rotated 
90°  fron  each  other.  The  planes  y • .1,  .2,  etc.  would  also  intarsect  these 
surfaces  in  parallelograms.  Both  Figure  4 and  Figure  5 show  that  the  — 
probability  a - min  (x,  y)  is  closest  to  the  probabilistic  product  at  the  two 
comers  where  x 0 and  y ■ 1 or  vice  versa.  In  the  region  where  both  X and 
T have  high  probability  (or  both  low)  the  minimum  function  makes  an  intuitively 
better  approximation  of  reality. 

If  someone  is  determined  to  use  the  functions  represented  by  plsnes 
rather  than  the  warped  surface,  it  slight  be  reasonable  to  select  the  floor 
or  roof  according  to  idiich  is  closer.  This  divides  the  function  into  four 
regions  separated  by  the  lines  x • 1/2  and  y - 1/2/ 

X < 1/2 

X > 1/2 


y.<  1/2  y>l/2 

0 I X 


y X + y - 1 


This  composite  function  is  graphed  in  Figure  6,  using  the  same  style  as 
Figures  1 to  3.  It  shows  how  four  plsnes  approximate  the  warped  shape  nicely 


Figure  6.  Min  or  Max  for  XAY 
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•t  the  corner*,  but  not  rcry  well  at  the  center.  Thl*  funeticn  would  In  nest 
cases  be  far  less  easy  to  implement  then  the  product  zy,  but  it  serves  to 
Illustrate  sm  important  fact.  Even  this  outlandish  function  has  the  same 
outline  as  the  other  three.  Thus  it  would  be  consistent  with  the  propositional 
calculus  to  use  the  table  above  to  find  the  probability  of  X A Y.  The  graph 
also  shows  the  indeterminacy  of  this  function  along  the  borders  between  the 
four  quadrants.  When  x - 1/2  the  whole  parallelogram  is  still  available  as  a 
range  for  a,  including  the  widest  possible  variation  (from  SB0toc*l/2) 
when  y - 1/2  also. 

4.  XV  Y 

A long  story  can  be  sutde  quit*  short  regarding  Z ■ X V Y.  The  maxi* 

<im«  probability  is  a ■ min  (x  *f  y,  1)  achieved  when  X and  Y avoid  each  other 
as  far  as  possible.  The  mirfimum  is  a ■ max  (x,  y),  achieved  when  one  charac- 
teristic set  includes  the  other.  The  probabilistic  formula  that  strikes  a mean 
between  these  two,  assuming  that  the  statements  are  independent,  issax-fy-xy. 
The  arguments  for  these  assertions  are  interesting  and  useful,  but  Figure  7 
shows  that  the  results  are  simply  a variation  of  those  for  Z • X A Y.  The 
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t«trah«droD  with  the  w«rp«d  lurfac*  inside  is  the  earlier  one  turned  upside 
down,  reflecting  the  fact  that  X V Y ■ X A n Y).  This  is  a variation  on 
deHorgan's  Law,  and  is  typical  of  the  conversions  that  logicians  use  to  make 
one  problem  look  like  another.  Such  conversions  are  not  without  pitfalls,  as 
will  be  shown  In  what  follows. 

5.  X^  Y 

5.1  Independent 

The  function  "exclusive  or"  is  very  different  from  the  "inclusive  or". 
Logicians  dispatch  the  difference  by  pointing  out  the  single  "comer"  X A Y, 
where  one  of  them  takes  the  value  0,  the  other  1.  The  difference  is  exaggerated 
when  consideration  is  given  to  the  whole  continuum  of  values  for  x and  y.  In 

applications  involving  information  from  various  sources,  the  word  "or"  may  be 

used  for  either  one,  and  so  blur  the  distinction.  A comparison  of  the  two 
functions  shows  how  big  a mistake  it  is  to  confuse  one  with  the  other. 

Three  possible  interpretations  of  "exclusive  or"  are  suggested  by 

jf 

English  paraphrases  that  can  be  used  to  explain  what  it  means: 

X or  Y but  not  both  (XV  Y)A-l  (X  A Y) 

One  is  true  and  one  false  (X  V Y)  A (n  X Vn  Y) 

X and  not  Y or  vice  versa  (XA-«Y)  V (iX  A Y) 

If  BBiltiplication  is  used  for  each  "A"  in  these  formulas,  sum-minus~product 
for  aach  "V  ",  and  subtraction  from  1 for  each  "*i",  the  first  two  give  the 
aasw  result,  but  the  third  differs  from  them. 

2 2 2 2 

(x  <f  y - xy)(l  - icy)  "x  + y-  xy-xy-xy  +xy 

(x  + y -xy)((l  - x)  + (1  - y)  - (1  - x)(l  - y))  ■ 

^ 2 2^22 
x + y-  xy-x  y->cy  +x  y 

x(l  - y)  + (1  - x)y  - k(1  - y)(l  - *)y  ■ 

2 2 2 2 
X 4 y - 3xy  4x  y4xy  - x y 


these  fomulee  ere  epplied  to  the  verioue  compoeite  repreeentetions  of 
I "exclusive  or";  * 

i 

I Bln  (mex(x,  y)*  1 - Bin(x,  y)) 

I min  (mex(x,  y),  bsx(1  - x,  1 - y)) 

I mex  (mln(x,  1 - y) , min(l  - x,  y)) 

An  eesy  wey  to  enelyse  these  Is  to  observe  thst  the  decisions  In  them  ere  all 

{governed  by  whether  x>  y or  by  whether  x + y>l.  So  they  esn  be  examined  for 
four  esses: 


x<  y 

lO  y 

X y<  1 

y 

X 

X + y>l 

1 - X 

1 - y 

These  results  ere  the  same  for  ell  three  versions!  Such  consistency  lends 
credence  to  the  basic  formulas.  The  result  is  neither  minimal  nor  msximsl,  but 
a pretty  fair  approximstion  of  the  curved  surface  by  four  planes,  as  shown  in 
Figure  9.  It  coincides  with  it  when  x - y ■ 1/2,  and  is  farthest  from  it  when 
X and  y have  values  of  1/4  or  3/4. 


I 


Itnse 


Th*  ■Inlaum  probability  for  "exclusive  or"  is  schisvsd  when  one  of 
the  characteristic  sets  is  included  in  the  other,  and  is  squsl  to  |x  • y|  . 
Ihs  ■stIm  occurs  whan  the  sats  ara  as  disjoint  as  possibla,  and  is  squal 
to  Bin  (x  4 y,  2 - x - y).  Thase  two  valuas  ara  graphad  in  Figure  10,  enclos- 
lag  a tatrahadron  that  shows  a wida  range  of  possibilities.  The  slices  are 


Figure  10.  Bounds  for  Exclusive  or 

rectangles  with  their  diagonals  rapresanting  the  probable  value.  The  one  for 
X - .5  is  a squera.  In  the  niddle  of  it  (where  y • 1/2  also)  the  probability  s 
can  ba  anything  from  0 to  1,  which  is  as  uncartain  as  a probability  can  gat. 

Tha  outar  adgas  of  all  thess  graphs  ara  tha  linas 


X ■ 0 and  a ■ y 
y • 0 end  a ■ x 
X ■ 1 end  a • 1 - y 
V ■ 1 and  a ■ 1 - X 


They  arc  shared  by  the  ■axleaai,  the  ■iniaun,  the  warped  auffaec  aaeumlng  in* 
dependence,  the  £our*planc  approxlauition  of  It,  and  the  t%«>  incorrect  fomulas 
derived  by  hasty  application  of  fonulas  in  the  test!  This  shows  that  all  of 
these  fonwlas  are  aquivalent  if  aither  X or  Y is  restricted  to  the  values  0 
or  1.  In  the  propositional  calculus,  both  arc  so  restricted,  and  so  all  these 
fomulas  are  correct  for  that  bbmII  subset  of  the  possibilities  for  two 
atateawnts. 

6.  VARIATIOWS  ON  A AND  V 

The  graphs  in  Figures  4,  7,  and  10  can  be  applied  to  other  cases. 

For  example,  the  graph  for  "X  A Y"  can  be  rotated  180®  to  represent  the 
probability  of  "neither  X nor  Y",  which  has  one  high  comer  at  x - y ■ 0 and 
the  other  three  low.  Indeed  a logician  might  say  that  any  function  of  two 
variables  could  be  expressed  in  ter^  of  negation  and  one  of  these  three  funda- 
mental fioictions.  The  "proof"  that  this  is  the  ease  is  based  on  the  analysis 
of  only  the  comers  of  the  domain.  There  are  only  16  two-valued  functions  of 
two  two-valued  variables.  Six  of  them  are  really  functions  of  only  one 
variable  (or  none);  four  are  logically  equivalent  to  "A"  and  four  more  to 
"V"  (with  selective  negations).  The  remaining  two  are  the  exclusive  or  (Just 
considered)  and  "if  and  only  if",  which  is  "exclusive  or"  turned  sideways. 

7.  IMPLICATIONS 

7.1  X«»  Y 

These  logical  equivalences  have  to  do  with  only  the  comers  of  the 
graphs  shown  here.  Many  surfaces  can  share  the  same  edges,  and  one  of  them 
■ay  be  appropriate  for  different  situations  from  another.  An  example  that  de- 
serves particular  attention  is  "if  X then  Y".  Almost  every  time  euch  a state- 
ment shows  up  in  connection  with  a logical  problem,  it  is  smmarily  replaced 
by  'Yiot  X or  Y",  and  then  treated  like  any  other  "or"  statament.  This  may  be 
Just  right  for  a system  where  everything  is  two-valued,  hmt  it  becomes  more 
complicated  with  continuous  variables. 
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Tht  probability  of  ***iXvy"  it  ahown  in  Figurt  11,  using  vertical 
planea  for  s • 0.1,  0.2,  ate.  In  each  plane,  a parallelogram  ahowa  the 
■avlBMi  probability  ala  (1  • x y,  1)  and  the  minimun  max  (1  • x,  y). 


Figure  11.  X4Y 

Betvoen  thaaa  axtreaea  ia  tba  valoa  that  aaaumea  independanee,  1 - x 4-  xy, 
rapreaented  by  diagonala  of  tba  parallalograma , which  daae^lba  a warped  aurface 
as  in  the  other  grapba. 

7.2  l^±Ji 


Tba  baale  aaawa^ticn  underlying  the  identification  of  "if  X then  Y" 
vith  "^XvT"  la  that  whenever  X la  falae  the  laplication  ia  true  by  default. 
Thua  either  a low  probability  for  X or  a high  probability  for  T eontributes  to 
the  likelihood  that  the  eonpoond  atatanant  ia  true.  If  thia  principle  is 
applied  indiaarinlnately,  it  can  lead  to  paradoxoa.  It  aakes  it  appear,  for  ex» 
aapla,  that  thia  atatanant  ia  very  likely  to  be  true: 

*^f  a wm  ia  over  2 wetera  tall,  kia  Maa  ia  leaa  than 
100  kilograaa." 
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F«w  Ml)  art  that  tall,  and  aott  art  that  light,  to  that  "not  tall  or  light" 
hat  a high  probability  - cvtn  hightr  than  "not  tall  or  heavy".  But  the  fact 
it  that  the  two  ntaturtt  are  not  independent.  The  tall  Mn  are  likely  to  be 
the  heavy  onet. 


To  make  a fairer  compariton  in  tuch  a cate,  the  diteuttion  thould 
be  limited  to  men  who  are  tall . Thote  under  two  Mtert  thould  not  be  counted 
at  aatitfying  the  ttatament,  nor  at  dittatitfying  it.  At  In  the  earlier 
illuttration,  it  would  be  beet  to  have  aeparate  data  on  the  Mttet  of  tall  men. 
But  even  in  the  abtence  of  tuch  inforMtion,  better  ettimatet  can  be  made  of 
the  probability  that  "if  X then  T"  it  true.  The  kind  of  implication  that  it 
equivalent  to  ""tXvY"  it  repretanted  by  Another  kind  of  implication, 

repreaanted  by  Y",  taket  into  contideration  only  the  catet  where  X it  true 
The  othert  are  omitted  rather  than  counted  at  true.  The  probability  of  "X-^Y" 
it  the  quotient  of  thr  ^obability  of  "XA  Y"  divided  by  that  of  X.  If  X and  Y 
are  independent,  thit  quotient  it  timply  y,  the  probability  of  Y.  But  it  can 
vary  greatly  for  eoM  valuet  of  x and  y,  at  will  be  daa»nttrated  by  thowing 
itt  Mximum  and  minimum. 


The  probability  of  'Tt-^Y”  it  at  leatt  max  (0,  1 - and  at 

mott  min  (^,  1).  Theta  limitt  are  graphed  in  Figure  12.  Each  plane  for  a 
fixed  value  of  x thowt  a parallelogram  reaching  from  c • 0 to  1.  The  diagonalt 


all  hava  tha  aana  alopa;  thay  font  tha  plana  a * y,  rapraaantlng  tha  inter* 
ncdlata  valua  aasumlng  iadapandanea  of  X and  Y.  For  aaall  values  of  x the 
parallelograaa  grow  quite  large.  Hhan  x • 0 tha  graph  opens  out  into  a square 
ahowing  no  restrictions  at  all  on  tha  probability  of  'X'^Y”. 


Comparison  of  Figures  11  and  12  shows  that  "X"^  Y"  and  *%-^Y", 
while  thay  are  identical  when  x ■ 1,  differ  s»re  and  snre  as  x approaches 
0.  One  set  of  limits  does  not  even  fit  inside  tha  other,  as  shown  in  Figure  13 


Figure  13.  Comparison  of  XmhY  and  X-^Y 


Hare  the  slices  for  x ■ .5  are  suparimposad.  Tha  limits  for  "X«^  Y"  are 
cross* hatched  vertically,  and  those  for  'IC-^Y"  horisontally.  and  it  can  be  seen 
that  for  y < .25  the  valua  for  *%«^Y''  is  above  tha  mavimiM  for  "X-^Y". 

The  smaller  pictures  show  how  correspomding  slices  for  x ■ .8  give  parallelo- 
grams that  are  close  to  each  other,  while  those  for  x ■ .2  differ  greatly. 


An  importCBt  application  of  the  fiaMtions  graphed  in  Figures  11  to  13 
is  the  analysis  of  tha  probabilities  involved  in  SSBffil*  state* 

mants  X and  X«bY  (or  X and  X«^T)  are  given,  than  Y follows  as  a oonaequanea. 
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What  ia  tha  affaec  of  probabilltlas  othtr  than  0 or  1?  Tha  anavar  is  alraady 
In  thaaa  grapha.  Thay  rapraaant  all  poaaibilltlaa  ragardlaaa  of  vhich  variable 
la  called  dapandant.  If  tha  probability  of  X ia  x,  and  that  of  tha  inplieation 
X^y  la  a,  chan  Figure  11  ahowa  that  x a auat  be  at  laaat  1.  Thia  ia  bacauae 
tha  probability  of  X^  Y (or^Xv  Y)  auat  ba  at  least  as  great  as  that  ofnX, 
that  la,  a > 1 - X. 


For  admiaaible  valuaa  of  x and  a,  Che  probability  of  Y ia  at  laaat 

- a ^ x a - 1 
X x 

darivad  fron  tha  aquation  of  Che  varpad  aurface  1 - a ■ x(l  • y).  Thia  ia  for 


X -f  a • 1 and  at  aoat  a,  with  the  reaaonable  intansediate  value  1 - 
fron  tha  aqu< 
an  implication 


If  a rapraaanta  the  probability  of  X^Y  tha  aituation  ia  quite 
different.  All  valuaa  of  x and  a are  then  admiaaible,  and  the  value  of  y ia 
at  laaat  xc  but  no  more  than  ! • x xa,  with  tha  raaaonabla  Intarmadiata  a 
Tha  ranges  of  possibilities  are  still  compared  in  Figure  13,  but  with  tha 
horlsontal  coordinate  raprasenting  tha  result.  Thera  is  no  ease  idiara  the 
range  of  y is  disjoint  for  tha  two  kinds  of  implication,  as  there  was  for 
thci.range  of  a.  For  values  that  are  admissible  for  both  kinds,  tha  two  ranges 
always  overlap  from  xs  to  a.  If  tha  statement  "if  X than  Y"  is  not  clearly 
Identified  as  X"^Y  or  X-^Y,  it  would  seem  safest  to  think  of  the  probability 
of  Y as  being  batwaan  these  narrower  limits.  This  range  is  illustratad  in 
Figure  14,  which  is  the  intersection  of  the  solids  shown  in  Figures  11  and  12. 
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mavii 


It  has  ona  warpad  aurfaca  (tha  front),  two  that  ara  plana  trianglas,  and  ona 
trlangla  with  a parabolic  notch  cut  out.  Its  slices  ara  trapezoids  like  those 
doubly  cross-hatched  in  Figure  13. 

The  comparisons  in  Figures  11  to  14  arc  not  entirely  fair  in  that 
they  do  not  show  the  interdependence  of  X^Y  and  X-t-Y.  The  conditions  that 
make  a high  for  one  of  them  also  make  it  high  for  the  other.  They  are  related 
by  the  formula 

(1  - probability  of  X^  Y)  - x • (1  - probability  of  X-r  Y) 


Thus  the  pairs  of  parallelograms  in  Figure  13  are  related  by  vertical  stretching 
or  shrinking,  with  the  top  edge  being  held  fixed.  A particular  pair  of  state- 
ments will  be  represented  by  points  in  corresponding  positions  on  the  parallelo- 
grams. The  discrepancy  between  the  values  of  e is  (1  - x)(l  - e),  which  is 
largest  when  x and  s are  small-,  but  almost  negligible  when  they  are  both  close 
to  1.  A formula  that  givas  satisfactory  results  for  large  x and  a may  be 
quite  inappropriate  for  small  values. 


8. 


RESOLUTIOW 


8.1 


The  Resolvent 


Modus  pooens  is  a special  case  of  deriving  one  statement  from  two 
others.  A siore  general  maneuver  is  the  use  of  the  "resolution  principle". 
When  a set  of  information  contains  the  statements: 


XV  V 


and 


YV-1  V 


it  is  useful  to  augment  the  set  by  the  "resolvent"  X V Y.  If  the  individual 
probabilities  of  X,  Y,  and  V are  known,  they  determine  (or  at  least  narrow 
tha  range  of)  the  probabilities  of  the  statements  and  of  the  resolvent.  A more 
likely  situation  is  that  probabilities  will  have  been  essig^ed  to  the  two  com- 
pound stetements  without  pertleular  knowledge  ebout  their  components.  If  x* 
is  the  probebility  thet  X V V is  true,  end  y'the  probebility  thet  TV*iV  is 
true,  whet  is  the  probebility  a of  X V Y? 
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Figurt  15«  ProbabilitiM  in  Rasolutlon 
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probability  could  range  from  max  (0,  x'+  y'-  1)  to  min  (x'  y^,  as  demonstrated 
previously.  But  the  way  V is  used  stakes  the  sets  avoid  each  other  as  such 
as  possible,  so  that  the  mininann  is  essuaied. 


I 


The  desired  probability  ofXVYlss-q-f-r-fs.  The  restrictions 
on  the  prdbabilities  make  p q > 1 - y'and  s -f  t • 1 - x^,  but  do  not  control 
the  individual  values.  So  it  is  possible  to  have  a situation  In  which 

end  q - i ■ 0,  making  the  probability  of  X v Y as  low  as 
possible,  nasmly  « • r ■ x'+  y'-  1.  It  can  also  happen  that  p > t » 0,  making 
s go  all  the  way  to  1 for  any  almlsslble  values  of  x'and  yC  These  bounds  are 
graphed  in  Figure  16,  using  x^and  y'as  Independent  variables  rather  than  x and  y. 
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Figure  16.  Bounds  of  Probability  of  Resolvent 


Intermediate  Value 


The  assignment  of  a "medium"  probability  for  the  resolvent  XV  y 
begins  with  the  assumption  that  W,  X and  Y are  independent.  With  so  many 
"or"  statements,  it  is  easiest  to  work  with  the  probabilities  that  they  are 
false.  If  V and  X are  independent,  the  probability  that  X v V is  false  is 
1 - iL  • (1  - w)(l  - *).  The  probability  that  Yv-i  V is  false  is  1 - y^«  w(l  - y). 
The  probability  that  the  resolvent  X v Y is  false  is  (1  - xXl  ” y).  *nd  the  other 
two  equations  imply  th.  r this  is  equal  to 


1 - a ■ 


- «K1  - y1 
w(l  - w) 


This  has  an  extra  variable  w in  it,  ao  that  it  does  not  yield  a single  func- 
tion of  x'and  y*  But  It  does  incorporate  the  aaaumptioo  of  independence,  so 
that  it  may  be  instructive  to  see  how  high  or  low  this  variable  probability  can 
go.  When  w - 1/2  the  denominator  of  the  fraction  is  largest,  and  this  leads  to 
the  highaat  probability  that  X V Y is  true,  namely  a ■ 1 • 4(1  - j0(1  - yO. 
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This  is  graphed  in  Figure  17.  It  le  a warped  surface  like  previous  graphs,  but 

( 

stretched  in  the  vertical  direction.  It, touches  e • 0 only  when  rf • y*m  1/2. 


Figure  17.  Probability  of  X v Y if  w ■ 1/2 


It  was  notad  previously  that  w sust  be  between  1 - y^and  xC  If  both 
s'and  y'are  above  1/2,  this  range  will  include  w ■ 1/2,  and  that  will  yield 
the  waxisaia  for  a.  The  siiniaum  will  be  achieved  at  one  end  of  the  range  or 
the  other.  If  w ■ 1 • y',  c ■ ^ *■"  ; if  w ■ x^,  e • lesser 

of  these  is  the  lower  bound  for  a.  If  either  x^or  y'is  below  1/2,  w cannot 
be  1/2.  In  those  eases  the  last  two  fomulas  represent  both  ends  of  the  range 
of  a.  The  ■axlsann  for  a turns  out  to  be  very  ouch  like  Figure  17.  The  surface 
like  a pitcher  spout  pointing  to  x^>  y'*  a • 1 represents  the  maxtnun  in  the 
whole  quadrant  x^>  1/2,  y*>  1/2.  Two  warped  surfaces  tangent  to  that  one  have 
tha  affect  of  slightly  filling  in  the  parabolic  edge  where  the  spout  mets 
the  wall  j* • 1.  The  spout  thus  aarges  into  the  wall,  aaeting  the  floor 

along  the  line  x' -f  y • 1. 


B-23 


✓ 


The  »««<«■  tm  for  « differ*  wry  little  from  the  bottom  plenc  ahown  in 
Figure  16.  It  he*  the  same  edge*,  but  i*  dented  elightly  where  it  interaects 
the  plan*  y*  The  place  where  the  mininum  over  all  W (aaauming  independence 
of  X and  Y)  1*  furthest  above  the  plane  • - x^+  y'-  I i*  where  x'«  y^«  <7/2  707. 

There  the  minimum  on  the  curved  aurface  i*  2 - <T  ^ .586,  while  the  absolute 
minimum  ahown  by  the  plane  i*  \T2  - 1**.414. 

The  ua*  of  w ■ 1/2  give*  not  only  a maximum  value  of  c,  but  in  a 
sen**  a typical  value.  The  denominator  w(l~w)  is  close  to  1/4  for  any  value 
of  w from  about  1/4  to  3/4  as  shown  in  Figure  18.  Values  of  w closer  to  the 


Figure  18.  Value  of  w(l  - w) 
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ends  of  Che  seal*  are  likely  to  b*  cut  off  by  the  limitation  that  1 - y^<  w < x'. 
So  it  may  be  that  a - 1 - 4(1  - x)(l  - ]/)  is  as  good  a formula  as  any  for 
aatlaating  the  probability  of  a resolvent. 

9.  the  choice 

9.1  lyfiiaK 

This  paper  has  discussed  the  full  rang*  of  possibilities  for  the 
elaasmtary  fanetioms,  md  has  tanerally  pointed  toward  the  os*  of  the 
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''independence''  forailee:  product  for  X A Y,  eusi-minus>product  for  X V Y, 
etc.  Theee  have  been  seen  as  a reasonable  coopromlse  between  the  linear 
•iniaax  fimctions  representing  the  highest  and  lowest  probabilities.  In 
contrast  to  this  approach  is  a lot  of  current  literature  that  assumes  the 
. use  of  min(x,  y)  for  X A Y and  max(x,  y)  for  X V Y.  The  first  of  these  is  the 
■STimmii  possible  value,  as  shown  in  Figure  2;  the  second  is  a minisstm.  as  shown 
in  Figure  7.  But  the  tiro  are  compatible  with  each  other,  because  the  probability 
of  Xv  Y is  always  the  sum  of  the  probabilities  of  X and  of  Y.  minus  the 
probability  of  X A Y,  The  subtraction  makes  one  go  up  when  the  other  goes 
down.  Thus  another  pair  of  compatible  formulas  is  those  at  the  other  end  of 

the  range:  max(0,  z y - 1)  for  XA  Y,  and  min(x  y.  1)  for  X v Y.  These 

are  not  so  simple  as  the  other  fonailas,  but  technically  they  deserve  as  much 

attention.  Why  are  they  not  included  in  the  discussions  that  seem  to  treat 

mln/max  and  independence  as  the  two  choices? 

A possible  answer  lies  in  a geostetrical  view  of  things  that  has  been 
illustrated  in  this  paper.  IWo  dimensions  represent  s domain  of  interest,  and 
a third  is  superistposed  to  show  the  range  of  a variable.  In  these  illustra- 
tions all  three  dimensions  represent  probability,  so  that  it  was  even  legitl- 
suite  to  turn  some  of  the  graphs  sideways.  The  domain  can  have  any  number  of 
dimensions,  but  the  simplest  illustrations  result  when  it  has  one. 

In  Figure  19  the  horisontal  dimension  represents  a one-dimensional 


Flfure  19.  Wntmum  - Mazimwi 
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universe  of  discourse,  end  the  verCicel  represents  some  function  defined  over 
that  universe.  It  can  be  probability  or  degree  of  sMsibership  in  a fuzzy  set 
(which  are  not  the  same  thing,  as  L.A.  Zadeh  pointed  out  in  1965  - Information 
and  Control,  vol  8,  page  340).  The  regions  under  two  rectilinear  "curves", 
eross*hatchcd  in  different  directions,  represent  two  such  functions,  which  may 
be  called  X and  y.  (It  does  not  matter  which  Is  which.)  The  doubly  cross- 
hatched  region  shows  a third  function  that  is  min(x,  y).  The  region  that  is 
cross-hatched  in  either  direction  (i.e.,  not  white)  displays  the  value  of 
nex(x,  y).  Variations  on  this  figure  appear  often  in  discussions  of  fuzzy 
sets,  and  are  used  in  defense  of  the  adoption  of  minimum  for  "and"  (or 
intersection)  and  maximum  for  "or"  (or  union). 

9.2  Independence 

The  "other"  fonmilas,  xy  and  x ■t'  y - xy,  can  be  visualized  by  a 
mathematician  looking  at  Figure  19,  but  do  not  stand  out  the  way  siin  and  max 
do.  But  independence  can  be  better  represented  by  using  two  different  dimen- 
sions for  X and  y.  In  Figure  20  one  of  them  is  shown  vertically  as  before. 


Figure  20,  Independence 

bot  the  other  is  plotted  from  back  to  front.  For  every  alamant  in  the 
iBivarse  there  is  a plane  aaetion  of  thia  eube,  typified  by  the  left  and  that 
shows  in  Figure  20,  irtiare  the  two  probabilities  happen  to  be  .4  and  .5.  The 


■ 
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doubly  erost-hatehod  ragioo  basaDaraa  of  .2  of  the  «hol*  aquar*,  or  in  general 
of  the  product  xy.  The  L-ahaped  non>«hlte  region  repreaanta  x -f  y • jcy 
(.7  at  the  left  end).  The  tnteraaetlan  of  the  two  aurfaeaa  ahowa  idtere  the 
comer  of  the  doubly  croaa-hatched  rectangle  la  for  all  elancnta  In  the  imlverae. 
In  thia  illuatratlon  the  winiia  and  ■axiaua  can  be  viauallcad  with  aoine  effort, 
hut  they  are  upataged  by  the  Independence  fonmilaa. 

9.3  The  Other  Extreme 

Much  of  the  diacuaalon  of  thla  aubject  treata  thaae  two  aa  if  they 
ware  the  only  cholcea.  Aa  haa  been  ahown  in  thla  paper,  there  la  really  a 
whole  apectrum  of  poaalbllltlea.  Min  and  max  are  at  one  and  of  It,  and 
Independence  In  the  middle.  Why  haa  the  dlacuaalcn  not  Included  the  other  end 
of  the  apectrum?  It  may  be  becauae  It  haa  not  been  given  an  appealing 
geoBMtrlcal  repraaentatlon.  But  there  la  one  available. 

In  Figure  21  are  ahown  the  aame  functlona  aa  in  the  prevloua  two 
flguraa.  They  are  both  plotted  aa  vertical  coordinatea,  but  they  atart  from 


Figure  21.  The  Other  Extr 


oppoalta  anda  of  the  aeala!  In  thla  unfamiliar  poaltlon  the  hitherto  neglected 
formulae  have  thalr  moment  of  glory.  The  height  of  the  doubly  eroaa*hatched 
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region  is  aax(0,  x ■«-  y • 1),  the  lowest  possible  velue  for  X A Y.  The  com- 
bined hAi^t  of  the  non-white  regions  is  min(x  4-  y,  1),  which  is  the  highest 
possible  velue  for  XV  Y. 

Xt  aey  well  be  asked.  But  doesn't  using  opposite  ends  of  the  scsle 
introduce  e strong  hies?  The  answer  is.  Yes,  and  so  does  using  the  same  and 
of  the  scale!  As  natural  as  it  sMy  seem  for  both  graphs  to  be  "upri^t," 
it  aakes  X and  Y overlap  as  much  as  they  possibly  can.  Thus  two  statements 
with  probabilities  pf  .1  each  are  displayed  as  coinciding  in  spite  of  all  the 
room  they  had  to  miss  each  other!  Similarly,  the  opposite-end  style  smkes 
two  .5's  miss  each  other  completely,  which  is  pretty  such  of  a fluke  too. 

Both  representations  are  extrenm  because  they  arc  showing  the  largest  and 
smallest  possibilities. 

An  appealing  thing  about  such  diagrasu  as  these  is  that  they  present 
perceptible  geoMtric  sets  to  represent  abstractions.  The  unions  and  inter- 
sections of  those  acts  seem  very  naturally  to  represant  corresponding  functions 
such  as  disjunctions  or  conjimetions  of  stateswnts.  The  intersection  in 
Figure  14  represents  a yielding  to  the  tesiptation  to  work  with  the  graphs  as 
entities  in  their  own  right.  The  identification  of  A with  A and  U with  v 
seems  like  good,  clean  Boolean  algebra.  But  it  is  an  oversimplification, 
coaiparablc  to  using  facts  about  the  cornera  of  a square  to  derive  conclusions 
about  its  whole  interior. 


i 

i 

I 
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10. 


A CREDIBILITY  FORMULA  FOR  COMPOUND  IMPLICATIONS 


If  AABACA  ...  ^ Q,  and  If  all  tha  antaeedanta  A,  B,  C,  ate., 

- art  trua,  than  Q follows  as  a consequence.  The  antecedents,  and  possibly  the 
isq>lleatlon  itself.  My  have  associated  with  them  nus^ers  in  the  interval 
C 0,ll  representing  degrees  of  credibility.  These  can  be  thought  of  as  prob- 
abilities, but  other  interpretations  are  also  possible.  This  paper  presents 
a way  of  assigning  a credibility  number  to  Q,  depending  on  the  credibilities 
of  the  other  statements:  <tj>  ■ f(<A>,  <®>,  <C>,...<AA  BA  CA  ...  ^Q>). 

IfiA  is  the  contradiction  of  A,  the  simplest  interpretation  dic- 
I tates  chat  <-tA>  > 1 - <i>.  But  this  is  not  the  only  possibility.  In  dealing 

j with  uncertain  sources  of  Irffonnation,  it  My  be  useful  to  think  of  <A>  and 

<-i  A>  as  two  numbers  whose  sum  is  less  than  1,  with  the  defect  representing  a 
range  of  uncertainty.  This  possibility  will  not  be  explored  in  this  note, 

I but  <i>  and  <-i A>  will  be  represented  separately,  without  any  assunption  that 

i.  either  one  datarmlnas  tha  other. 


The  complexity  of  the  problem  to  be  considered  here  is  evident  from 
tha  "simplest"  ease,  in  which  there  is  only  one  antecedent.  The  credibilities 
of  <A>  and  <A^(>  do  not  vary  closely  control  that  of  <Q>.  For  example, 

<A*^q>  might  represent  tha  statement,  "If  a number  is  priM,  it  is  odd."  This 
statement  has  a credibility  slightly  lass  than  1,  because  the  number  2 is  prime 
but  even.  Suppose  it  has  bean  determined  that  the  probability  that  N is  prime 
is  .6;  what  is  tha  probability  that  N is  odd? 

If  N really  is  prime  it  is  very  probably  odd,  and  this  suggests  a 
probability  Just  under  .6;  but  even  if  N is  not  priM  it  has  a chance  of  being 
odd,  and  this  My  add  almost  .2  more  to  tha  chances,  for  a total  Just  under  .8. 

In  any  situation  like  this,  it  would  be  useful  to  Vmow  two  credibilities, 
which  arc  best  described  In  terms  of  probabilities,  but  can  ba  applied  also  to 
ocher  interpretations  of  credibility.  The  universe  of  discourse  contains  four 
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kind*  of  •Icmcnti,  with  thoir  total  nuabar*  rapra««ntad  by  the  lattar*  in  this 
chart.  The  total  W'fxH-y4g  is  taken  to  be  1. 


Q true  Q false 


A false 


The  probability  of  A^Q  is  w 4 y + a.  That  of  A is  w 4 x. 

Knowing  these  two  nuod>ers  does  net  aaks  i^^MSible  to  find  <Q>  ■ w 4 y.^  But 
the  conditional  probability  of  A-^  Q is  w 4 x,  and  that  of"iA-^Q  is  y 4 a. 

If  both  of  these  nuabers  are  tatown,  the  probability  of  the  consequence  is  given 
explicitly  by  the  fomila 


If  a rule  of  the  form  A«^  Q can  have  two  such  nunbers  supplied  with  it,  good 
estiawtes  can  be  awde  of  the  credibilities  of  consequences. 


The  A in  the  above  discussion  could  be  taken  to  represent  a conjunc- 
tion of  several  antecedents,  so  that  the  whole  discussion  wbuld  apply  to  other 
situations.  But  another  illustration  can  show  that  this  night  be  hasty.  Con- 
sider the  rule: 


(x  works  with  y)A  (y  works  at  a)^  (x  works  at  a) 


A single  credibility  for  this  rule  would  be  quite  high,  falling  short  of  1 only 
because  of  such  snonalies  as  people  who  work  on  nore  than  ane  thing.  The  other 
credibility  that  ought  to  be  known  is  that  of  the  supplanantary  stataewnt: 


How  can  ons  madber  describe  such  a probability?  If  x does  work  with  y but  y 
does  not  work  at  a,  there  is  praetieally  no  chance  that  x works  at  a.  lf,cn  the 
other  band,  x does  not  work  with  y,  idiile  y does  work  at  a,  it  still  night 


^•rj  wall  b«  tm*  that  s worka  at  a.  And  if  both  antaeadanta  ara  falaa,  tha 
probability  could  ba  alaoat  anything,  dapanding  on  tha  unlvaraa  to  idileh  x 
balonga.  Mow,  if  four  probabilitiaa  could  ba  giwan  in  connaction  with  auch  a 
rula,  tha  problan  would  ba  aolwad: 


For  thraa  antaeadanta  thara  would  ba  aight  tama  in  auch  an  axpraaaion,  for 
four  antaeadanta  aixtaan,  and  for  n antaeadanta  2*^.  Thia  vary  quickly  gata 
eumbaraona,  and  will  not  ba  purauad.  But  ona  thing  will  ba  aalvagad  bafora 
it  ia  droppad. 


Tha  probability  of  <A  a B>  ia  not  aimpla  itaalf,  involving  a con* 
ditional  probability.  But  it  haa  baan  damonatratad  in  2330- TN-1  that  tha 
aaauaption  of  indapandenea  almplifiaa  thia  without  baing  vary  likaly  to  do 
aarioua  damaga.  Tha  aaauaiption  that  <Aa  K>  ■ <A>  <B>  makaa  tha  anauing  dia- 
cuaaion  vary  anieh  aiaplar  than  it  would  ba  without  it,  and  will  accordingly  ba 
adoptad  taaiporarily.  Latar  it  will  ba  diaeuaaad  how  to  eopa  with  Intarda- 
pandanca  of  antaeadanta. 


Tha  eaaa  of  thraa  antaeadanta  (AabaC  Q)  will  ba  uaad  as  a 
vahicla  to  diacuaa  a taefaniqua  that  appliaa  to  any  nua6ar  (avan  1 or  2). 


Tha  aiaiplaat  approach  ia  to  aupply  one  credibility  for  tha  rula 


For  aoma  rules  way  ba  1,  but  it  can  ba  considerably  lower,  as  in  tha  ex- 
hortation: "If  you  stand  right  and  keep  your  aya  on  tha  ball  and  swing  level 

you  will  hit  it." 


f Th«  MtttiBg  of  th«  throt  conditions  corresponds  to  being  et  one 

I vertex  of  e cube  (or  in  generel  en  n»di«»ensionel  orthotope).  Seven  other 

I vertices  (or  2°  - 1)  represent  verious  kinds  of  poor  technique,  the  worst  of 

which  is  the  opposite  vertex.  But  even  e better  with  his  feet  in  the  bucket 
^d  e bed  eye  ^d  en  awkwerd  chop  has  some  chance  to  hit  the  ball.  (Whether 
lit  will  pop  up,  ground  out,  etc.,  is  another  question.)  The  coech  t#ay  be  eble 
to  supply  eight  probabilities,  each  to  be  sMltlplied  by  the  probability  of  its 
eonbination,  such  as  <A>  <nK>  <0  for  good  stance,  bed  eye,  good  swing  (swlti- 
j plication  being  used  on  the  assumption  of  independence).  It  turns  out  that 

these  2”  nuwbers  can  be  replaced  by  only  n + 1 (including  2^). 


What  is  called  for  Is  an  estimate  of  the  results  of  each  single  kind 
of  failure.  In  the  example,  these  might  be: 


■ .6  poor  gtanec  rcducti  hit  probability  to  .6  of  what 
It  would  hava  baen  with  good  atanea; 

Zg  ■ .3  aya  off  tha  ball  raducaa  to  .3; 

Z^  - .5  Impropar  awing  euta  chancas  In  half. 

Tha  naw  Z'a  ara  not  probabllitlaa  all  by  themaalvas,  but  factors  that  raduce 
tha  ovarall  probability  Z^: 

Z^  Z^  - A aBaC  Q> 

Z_Z  •<Aa-»BaC-»Q> 

o O 

Z_  Z - <A  A BATC  Q>. 

la  O 


If,  for  axampla  Z^  • .8,  tha  thraa  medloera  battara  hava  hit  probabllitlaa  of 
.48,  .24,  and  .40,  raapactlvaly. 

Tha  probabllitlaa  for  tha  thraa  poor  battara  who  do  two  thlnga  wrong, 
and  tha  ona  raally  bad  ona,  ara  takan  eara  of  automatically  by  thla  formula: 

<fj>  - Z^  (<A>  + Z^  <-«A»(<K>  + Zj  <-iB>)(<C>  + Zj,  <-iC>). 

Each  Z^  ia  multiplied  by  tha  probability  of  failure  and  tha  product 

ineraaaad  by  the  probability  of  auccaaa  <0^.  Thaaa  auma  ara  all  multiplied 

together  along  with  Z . 

o 

Thla  la  the  working  varalon  of  tha  formula.  Involving  2n  multlpllea- 
tlcB  and  n addltlona.  Tha  axpanalon  below  la  not  Intended  to  ahow  an  altama* 
tlva  proeadiira,  but  to  display  tha  result  in  a way  that  clarifies  how  tha 
formula  parlays  n 1 eradlbllltlaa  Into  2°.  Tha  algebraic  laultlpllcatlon  gives 
thla  product; 


<q>  • Zp  («»>  <a>  <o  z^  <-iio  <s>  <o  + z^ 


<A>  <-»!>  <0  ♦ 


Zg  <i>  <!>  <-iO  + <"U>  <-«a>  <0  + Z^  Zg  <-»#>  <K><-iO  + 

Zj  Zg  <A>  <-iB>  <-»0  + Z^  Zj  Zg  <1A>  <-iE>  <nC>) 
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Th«  futors  <A>|  <^t  <X>  •PP**r  with  «v«ry  combination  of  negations,  making 
a full  2®  terms.  If  each  X>  • 1 - 4C>,  these  products  all  add  up  to  1. 
Each  one  Is  multiplied  by  the  product  of  the  Z*s  for  all  the  failures  It  in- 
volves . This  carries  through  the  Idea  of  Independence  giving  good  madlun 
alsed  Mtlmatea  for  probabilities.  The  intuitive  appeal  of  the  reaults  can 
be  aean  In  the  batfclng  llluatratlon,  where  the  coefficients  are: 


Each  one  Is  multiplied  by  Che  overall  - .8,  giving  the  worst  batter  only 
•072  of  a chance  of  putting  the  wood  oa  It,  while  even  the  best  gets  only  .8 
of  a chance. 

A 'Veally  good"  rule  has  a high  value  of  Z^,  signifying  that  if  the 
conditions  arc  met  tbs  consequence  Is  really  likely  to  come  off.  In  some  eases, 
like  "x  works  with  y^y  works  with  It  Is  appropriate  that  Z^  " 1.  Another 
eharaeterlstle  of  a "good"  rule  la  low  values  of  the  other  Z numbers.  If  a Z 
Is  high.  Its  corresponding  condition  la  not  really  Important.  The  batter  might 
think,  for  example,  that  he  should  have  a rabbit's  foot  2b  his  pocket  (D),  but 
objaetive  analysis  might  reveal  that  Z^  ■ 1.  (k>  the  other  hand,  having  a bat 
in  his  hand  (E)  la  important  that  It  could  be  taken  for  granted,  and  Z^  - 0. 

gimllarly,  "really  good"  data  has  high  values  of  <l>  and  low  values 
of  This  moans  that  in  a system  with  good  information,  most  of  the  terms 

of  the  above  expansion  will  be  mleroseople.  It  is  tempting  to  use  this  as  an 
exeuae  for  an  oversimplified  formula.  The  one  given  here  appears  to  give  the 
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"negligible"  quantities  their  due,  and  this  is  likely  to  yield  benefits  in  any 
system.  But  it  becomes  especially  valuable  when  the  rules  and  data  are  "not 
so  good". 


The  formula  works  for  all  values  of  n.  The  ntmber  of  operations 
involved  in  it  grows  linearly,  but  the  effective  number  of  terms  (as  shown 
in  the  expanded  version)  grows  exponentiall>b  It  should  be  noted  that  for  n - 1, 
the  interpretation  is  slightly  different  from  what  was  said  above  about  that 
case.  is  the  same  as  <A-*Q>.  The  supplementary  probability  <“«A  “»Q>  is 
not  Z^,  but  Z^  Z^.  In  general,  <-iA-»Q>  will  be  low  for  a good  rule,  so  that 
dividing  <-iA-^Q>  by  Z^  will  give  a value  for  Z^  that  is  below  1. 

The  formula  is  coonutative  in  the  sense  that  the  conditions  may 
appear  in  any  order.  The  different  Z's  will  do  their  Job  without  any  restric- 
tion such  as  treating  them  in  order  of  their  "goodness".  There  is  also  an 
important  sense  in  which  the  formula  is  associative. 


A conclusion  may  often  appear  as  a consequence  of  many  conditions, 
even  in  a simple  system  trttere  the  rules  never  have  more  than  two.  If  an 
analysis  uses  the  statements  A A P and  Pa  C to  arrive  at  the  conclusion 
Q,  it  may  well  be  said  that  Q is  true  because  A and  B and  C are  true.  It  is 
interesting  to  see  what  distinction  appears  in  the  use  of  this  formula. 

Suppose  that  the  rule  A*  B'^P  has  credibility  numbers  Z^,  Z^,  and 
Zg,  as  defined  above,  and  the  rule  Pa  C>^Q  uses  Z^  (in  place  of  Z^)»  Z , and 
Zg.  Then: 

<P>  - Z^  «A>  + Z^  <-iA»«K>  + Zg  <-iB>); 

<qp>  - Z,  (<K>  + Z <-«  E>)«C»  + Z-  <-iO)  - 

1 P Vs 

Zj  (Z^«A>  + Z^  <-»d»«E>  + Zj  <-i B»  + Zp  <-iR>)«0  + Z^  <-nO). 

Nov,  if  the  second  rule  is  "really  good"  with  raspaet  to  P,  Z will  be  ssiall, 
possibly  even  sero.  If  Z^  - 0,  the  expression  for  <Q>  simplifies  to  Just  what 
it  would  have  been  for  one  rule  AaBaC«^Q,  using  the  same  values  for  Z^,  Z^, 
and  Z^,  but  with  the  overall  credibility  Z^  Z^,  the  product  of  those  for  the 
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two  individual  rulaa.  A non-zero  value  for  Z will  raise  this  credibility, 

P 

reflecting  the  fact  that  Q follows  not  only  from  C,  but  from  an  additional 

donain  where  P is  true  even  though  A and  B are  not  both  true. 

This  way  of  combining  two  rules  into  one  can  also  be  applied  to 
aaparating  one  rule  into  two.  It  may  be  useful  to  replace 

AaBACADAE 

by  two  rules:  DAE^K  and  AabaCaK^Q.  One  place  this  may  have  practical 

value  is  in  the  case  that  D and  E are  decidedly  not  independent,  so  that  they 
upset  the  validity  of  the  overall  scheme.  If  they  are  pulled  out  of  the 
rest  of  the  sat,  they  can  be  analyzed  separately: 

<X>  »^aE><DA^-v1C>  -f 

^ A-i  ^ <DA— ^ E + 

<-s  D A E>  D A E 

<-iD  A— I E>  <-iD  A-i  E-v  K> 

The  atomic  probabilities  <Dae>,  etc.,  can  be  found  other  ways  than  by  the 
product.  For  example,  if  <EC>  and  <E>  arc  both  high,  and  the  two  statements 
D and  E arc  decidedly  negatively  correlated,  it  might  be  appropriate  to  use: 

<D  A ^ B 4 <E>  - 1 
^A— 1 ^ 4-  1 • 

<-i  D A & ■ 1 • 

<iD  A-i  E>  - 0 

The  associated  conditional  probabilities  could  be  supplied  for  these  two 
variables  out  of  context  far  more  easily  than  when  they  are  tangled  up  with 
A,  B,  and  C also.  Then  making  2,^-0  would  make  this  pair  of  rules  Just  like 
the  original  single  rule.  But  soma  other  value  of  might  be  chosen  for  even 
better  accuracy. 
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APPENDIX  C 

CONDITIONAL  PROBABILITY  IN  RULES 


CONDITIONAL  PROBABILITY  IN  RULES 


{ 

I 

t 
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The  most  practical  method  of  obtaining  the  credibility  <r>  of  a de- 
rived fact  r from  the  rule: 

pAqs>r  given  <p>  and  <q> 

consists  of  treating  the  hypothesis  pAq  as  a single  fact  hypothesis.  Thus: 
<r>  ■ <(pAq)— > r>*<pAq>  + <n(pAq)^  r>*<-i(pAq)> 


The  two  conditional  probabilities  are  analogous  to  the  tvo  Inference 
rule  credibility  numbers  and  are  expected  to  appear  normally  in  the  STIS  infor- 
mation. Thus: 

(<^(pAq>-»  r>,  <(pAq)->r>)  pAq=^r 

Thus,  the  <r>  computation  is  simple,  most  particularly  in  the  case  where  <pAq>  « 
<p>*<q>  because  of  independence  or  the  likely  case  that  no  conditional  prob- 
ability is  known  linking  p with  q.  Here  ve  are  concerned  with  the  less  usual 
situation  where  more  complete  conditional  probability  information  is  available. 
Ue  adopt  the  notation:  * 


On,  n)  p=^q 

to  mean 

<-ip->  q>  “ m and  <p->q>  ■ n 
Comaider  the  example: 


(.15,  .9)  pe^q 

P A 


<p>  • .85 


is  to  MCimate  <x>.  As  an  intermediate  step  we  estimate  <p  A q> 
Py  the  conditional  probability  law: 

<p  A q>  • <p>  <p  q> 


C-1 


Ve  observe,  now,  that  the  .9  number  Is  the  condltonal  probability 


I 

H 1 


<p-»  4> 

Therefore,  our  work  is  simply: 

<p  A • <1^  <P*^  “ (.85) (.9)  “ ,765 


Since  we  have  assuised  our  main  rule  (pAq:^r)  as  being  of  full  certainty;  we  have: 
pA  q«^r  or  (0,  1)  p«^q 


! 


I 

I 


which  is  to  say  that  the  consequent  never  falls  when  the  hypothesis  is  true. 

Ve  also  have  (as  presented  above)  the  consequent  necessarily  false  when  the 
hypothesis  is  false,  llierefore,  we  obtain: 

<r>  • (1)(.765)  » .765 

Now  we  proceed  with  the  second  matter,  namely  the  credibility  features 
intrinsic  to  the  main  implication  itself: 

pA  q-^r 

Ne  jdevclop  the  previous  pattern . for  credibility  numbers  in  a rule  using  as 
an  example: 


where  <r>  ■ ,95  when  <p>  ■ <<f>  • I,  or  .95  ■ <pAq 

<r>  • .1  when  <'Hp>  ■ 1,  or  .1  ■ <‘^p  A q<-p  r> 

<t>  ■ ,05  when  <p>  • <1<I^  • 1,  or  ,05  ■ <pA"^  q-er> 

Ve  make  an  initial  estimate  for  <r>  based  on  the  truth  estimate 
of  the  hypothesis  slone. 

initial  estimate  <x>  • (,95Xp  A q>  • (,95)(,765)  - .727 
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V«  alao  noca  that  avary  saction  of  this  Venn  diagram  has  an  appropriate 
intarpretatioD  in  the  above  work  estimating  <r>  - .735*  which  is  diagrannaticslly 
imdersealed.  We  list  a few,  as  follows: 


<p>  - ,85 
<p-»  ^ > .9 
<-ip-^<f>  - ,15 
<p  A 4>  . ,765 
initial  <r>  - ,727 
first  correction  <r>  - ,0C2 
second  correction  <r>  * .004 


assumption,  also  underscaled 
assumption,  underscaled 
assumption,  over scaled 
ealealated,  underscaled 
calculated,  unshaded,  underscaled 
calculated,  marked  , overscaled 

calculated,  marked  , overscaled 


We  further  note  that  a third  possible  correction  for  <r>,  in  the  event  that  both 
p and  q individually  fall,  has  been  neglected. 
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LUSTRATIONS  OF  THE  USE  OF  REPORT  LIKELIHOOD 


USE  OF  REPORT  L 


VENN  DIAGRAMS 


V«  suppose  the  feet: 


.75,  WA(2,7) 


might  sppesr  dlsgrssnstlcally  thus: 


where  the  fact  WA(2,7))  appears  as  a circle  surrounding  a truth  area  comprising 
7SZ  of  the  universe  area.  Nov  we  proceed  to  apply  this  graphical  scheme  to  the 
credibility  ideas  pertaining  to  syatem  reports. 

In  our  illustration  we  develop  the  likelihood  ratios  of  two  reports  on 
the  fact  WA(2,7>,  namely: 


1 • .75 


<HA-VR 


1 - .80 


Xh«t«  art  based  on  tha  two  reports  Introduced  as  follows: 


.75,  Rj-*  HA(2,7) 

.80,  R2-pWA(2,7) 

'where  the  credibility  nunbers  are  the  usual  probabilities  for  the  truth  of 
the  UR  fact  based  on  the  appropriate  report  alone  (under  the  inportant  assump- 
tion that  <WA(2,7)>  starts  from  an  old  credibility  estimate  of  .50,  prior  to 
both  reports.) 

We  represent  this  situation  with  the  following  Venn  diagram: 


in  which  the  Rj>  probability  Is  represented  by  the  enclosure  of  1/4  the 

area  inside  the  R^  loop.  The  Rj>  probability  is  represented  by  the 

enclosure  of  3/4  the  WA  area  inside  the  R^^  loop.  Thus,  the  likelihood  ratio 
indicates  the  degree  to  which  the  R^  loop  prefers  the  truth  value  set  of  the 
fact  UA(2,7).  When  l[wa(2,7)hs> R^]  - 1,  the  R^  report  may  be. though  of  as  indepen 
dant  of  the  UA  fact,  that  is,  the  R^  report  shows  no  preference  between  the  two 
sides  of  the  WA(2,7)  oval.  When  l[wA(2,7)-w  R^]  is  large,  we  have  the  Rj  report 
nearly  inside  the  WA  truth  set.  This  is  the  idealistic  situation  where  the  re- 
port R^  is  highly  reliable,  and  the  Bayes  result  Is: 

^new['*^<*»^J  " rJ  X-old 

. l[wA(2,7)-»  rJ  (1) 

msAlng  that  <UA(2,7)>  Is  almost  unity  and  the  fact  is  assured  a high  likelihood. 
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W«  node*  that  tha  aana  stata  of  affairs  can  also  ba  raprasanted  by 
a nair  oval  which  anclosas  only  1/4  the  MA  araa  and  3/4  tha  WA  araa. 

Xhls  way  ba  thou^t  of  as  having  tha  sama  valua  and  tha  sasia  llkallhood  ratio 
as  tha  aarllar  report.  Tha  dlffaranca  batwaan  tha  two  way  ba  thought  of 
raatlng  in  how  appropriate  tha  report  Is  to  appear  and  in  that  alone. 

Whan  tha  two  loops  are  nearly  identical  (reports  duplicate  substan* 
tially),  then  the  Intarsaction  araa  A Rj  gives  no  substantial  likelihood  ratio 

inprovament  (the  prafaranca  for  the  VA  truth  sat  is  relatively  unchanged).  The 
Vann  diagram  as  actually  drawn  indicates  high  independence  of  reports  Ri  and  R2 
with  a Joint  llkallhood  ratio  approximately: 


- 3 X 4 - 12 


Such  a computation  is  exactly  tha  result  of  applying  tha  Bayes  technique  con* 
sacutivaly,  with  tha  normal  assumption  of  raport  indepandanca. 


INITIAL  FACT  LIKELIHOOD 

In  tha  text  of  this  report  we  have  sMda  a simplifying  assumption  that 
tha  historically  astablishad  cradibility  astimata  is: 


bafora  tha  appearance  of  tha  two  reports  muu  R2  are  to  ba  accounted  for. 
The  simplification  Is  a rasult  of  the  use  of  tha  resulting  L^j^^  [WA(2,7)1  • 1 
in  the  Bayes  relation: 


[l»]. 


new 


<WA”^R|>  fji 

<«A-WR,>  * 


D>3 


J 


in  which  the  report  can  be  eheraeterlsed  in  each  of  two  equivalent  ways: 
l[wA(2,7)->Rj]  - 3 (-  ) 

<R£-»  WA(2,7)>  - .75 

The  slapliflcation  is  only  eoaputatianal,  as  we  will  Illustrate  below. 

Ve  do  the  same  problem  with  the  following  alteration: 

<MA(2,7)>^j^j  ■ .05,  instead  of  .5 

If  facility  #7  Is  one  out  of  a total  of  20  facilities,  the  new  assumption  repre* 
sents  an'  approximate  aero  information  state.  The  previously  assumed  value  of  .5 
really  represents  a lot  of  information:  person  #2  is  as  likely  (or  more  so)  to 

work  at  facility  #7  as  at  any  one  amongst  all  the  remaining  19  together.  Let 
us  see  what  is  the  result  of  applying  the  saaie  R2  reports  with  this  new 
fact  assumption.  We  get  from  two  applications  of  the  Bayes  rule: 

This  means  that,  after  the  R^,  R2  reports  are  accotinted  for,  we  have: 

<WA(2,7)> 

' * ' new  ■ 12 

1-  <WA(2,7)>jj^  19 

• i9*hT  ■ M 

We  notice  that  the  WA  credibility  still  falls  short  of  the  1/2  level.  One 
■ore  report  of  value  approximately  that  of  R^  or  R2  will  suffice.  We  can  see 
irttat  sort  of  R^  would  be  required  by  reapplying  the  Bayes  Theorem  in  a differeit 
■amior,  where  it  la  now: 

^old  ■ 19  ^new^' 

1 # 

b-4 

^ ^ II <111,.. 
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Th«r*fore; 


L [WA-*-  Rj] 


19 

12 


Sine*  ^ < 3 < 4 

V*  •••  that  R^  !■  !•••  than  R^^  or  R2  in  value,  to  bring  the  final  fact  credi- 
bility to  Juat  1/2.  e 

INFORMAnON  MEASURE 

Since  w*  have  already  identified  the  value  of  a report  with  its 
likelihood  ratio,  we  already  have  an  indicator  of  the  amount  of  information  of 
a report.  The  more  valuable  a report,  the  more  information.  However,  we  do 
have  a situation  where  two  reports  t^th  likelihood  ratios  of  3 and  4 have  the 
same  information  content  (or  value)  as  on*  report  with  likelihood  ratio  12. 

Another  scale  is  possible,  such  as  is  used  in  psychological  measurements. 

■ - « 

He  consider  the  information  measure  for  a report  R as  defined  to  be: 

- Ln  (l[wA-»  r]) 

- Ln  (l[wA-»  r]) 

1.10 

1.39 

0 

2.49 

in  which  w*  see  that  the  information  awasures  add  up  pleasantly.  One  \mit  of 
information  in  a report  means  that  the  likelihood  ratio  of  a system  fact  is  in- 
creased by  a factor  of  * ■ 2.718. 


D-5 
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He  tabulate  the  following  results : 

Report  lCwA-*  r1 

Rj 3 V 

R2  4 

useless  1 

report 

(R^  and  R2)  12 
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This  aaphuisM  that  an  individual  raport  is  veil  identified  by  the 
amount  of  Infortaation  it  brings,  or  alternatively  by  the  report  likelihood  ratio. 
For  example,  our  first  report  was  characterised  thus: 


LrWA(2.7)-^  rJ  - ^A(2,7)-^R^>  . 3 
*■  ^ <5IA(2,7)-eR3> 


with  no  dependence  upon  the  state  of  initial  information  about  WA(2,7)  before 
the  appearance  of  R^.  On  the  other  hand,  it  was  natural  to  first  introduce 
with  the  statement: 


,75,  R -»WA(2,7) 


because  It  focuses  attention  on  the  credibility  of  the  fact  which  Rj^  deals  with. 
But  if  the  fact  UA(2,7)  is  already  established  at  the  .90  level,  for  example,  we 
see  how  confusing  such  a method  is  for  report  characterisation.  This  is  why  the 
normalising  assumption  became  necessary: 

<«A(2,7)>oid  - 0.5 


RULE  CONSISTENCY 


1.  AN  EXAMPLE  OF  A SELF-CONSISTENCY  PROBLEM  IN  A SINGLE  RULE 

We  use  the  following  notation  for  a simple  logical  implication: 

(.05, .70)  p^q 

where  the  two  probability  estimates  are  defined  thus: 

0.70  > <p-irq>  “ probability  estimate  that  the 
consequent  q is  true  In  the  event  that  the  antece* 
dent  p is  true. 

0.05  ■ <-ip-^<f>  ■ probability  estimate  that  the 
consequent  q Is  true  in  the  event  that  the  antece- 
dent p is  false. 

So  far  there  la  no  possibility  of  a failure  in  self-consistency,  although  the 
> estimation  of  probability  may  be  poor.  For  an  antecedent  of  probability  <p>  - 
0.75,  a Venn  diagram  with  areas  proportional  to  probability  might  appear  thus; 


Assumed : 

<pC>  - .75 
<p*v<J>  - .70 

<-»  P'»q>  - .05 


With  the  aid  of  the  Venn  diagram  interpretation  it  is  fairly  easy  to  gain  con- 
viction that  if  the  .70  and  .05  estimates  are  replaced  by  any  other  two  proba- 
bility numbers,  the  implication  p^q  is  at  least  self  consistent. 

If,  now,  we  consider  the  contrapositlve  of  the  original  implication 
~ rule  we  might  then  obtain: 

(.10,  0.80)  -iq^-ip 

0.80  ■ <-«q*^-»p> 

0.10  ■ <q->-i  p>  (—1  (-iq)*  q) 

We  have  defined  the  probability  estimates  in  perfect  analogy  with  the  defini- 
tions for  the  original  rule  p^q.  We  note,  however,  that  the  two  probabilities 
are  quite  distinct  from  the  original  <p-^  q>,  <-i  p-w  qp>  probabilities.  There 
is  a relationship,  of  course,  but  it  is  not  superficially  obvious.  We  have  also 
supposed  that  the  .10,  .80  estimates  have  been  Independently  made. 

It  is  natural  to  consider  the  contrapositlve -iq^-ip  because  in  simple 
logic  It  is  fully  equivalent  to  the  original  p«^  q statement.  It  is  often  used 
as  a proof  method,  where  to  prove  pap  q we  consider  the  reverse  posslbility-iq. 

With  the  probabilities  showing  up  as  four  Independently  estimated  numbers,  there 
Is  a definite  possibility  of  a self  inconsistency.  This  can  be  suspected  from  an 
examination  of  the  Venn  diagram,  which  has  four  areas  which  must  add  up  to  unity, 
so  that  there  are  only  three  degrees  of  freedom.  We  look  therefore  for  a necessary 
relation  amongst  the  four  probability  estimates,  having  assumed  our  rule  in  the 
two  forms: 

(.05, .70)  q 
(.10, .80)  -I  q^np 

We  can  also  assuM  the  specific  Illustration: 

p e system  #7  is  being  developed  at  facility  #4 
q e a subsystem  of  system  #7  is  being  developed  at  facility  #4 
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V*  «l«o  usxBM  that  thara  ara  a total  of  15  facilltiaa.  Suparficlally,  tha 
probability  aatlaataa  appaar  plausibla.  For  axanpla,  (<-^p-P^  ■ ,05)  if 
it  ia  dafinitaly  known  that  systaa  #7  it  not  baing  davalopad  at  facility  #4, 
than  thara  is  a lass  than  1/15  chanea  that  an  assoeiatad  subsystaai  is  baing 
- davalopad  thara. 

To  obtain  tha  nacassary  ralationship  anong  tha  four  probability 
astlaMtas  wa  conputa  aaeh  of  <pA  ^ and  <pVq^  in  two  diffarant  ways: 

<p  A ^ ■ <p>  <p<aq>  ■ <(f»  <q^  p> 

<pV^  ■ 1 - <TP>  <T  p-V'-iq^  ■ 1 - <-i  ^ 

with  tha  intantion  of  alisiinating  <p>,  <<^  amongst  tha  aquations  to  arriva  at 
tha  ralation  amongst  our  four  conditional  probability  astisMtas.  Tha  abova 
ara  aqui valent  to: 


I 

1 


and  obtain: 


I 


i 

t 


t 


<-»j> 


(B^ 


. ^ <no-»  <-iP-»>td> 


Mow  wc  aakt  uaa  of  <p>  + <-»  p>  ■ 1 In  (A^)  and  (B^)  and  arrive  at; 


1 - I + 1 

. , <0^-10  <p-»q>  . , t> 

<-»p  qj>  <q  ^ l£>  <p^ -»<p>  <-^q<v -np> 

Va  note  that  the  four  aetlmated  probabllitlee  are: 


<p^q^  ■ .70  <“ip^q^  • .05 

■ .80  ■ .10 


We  alao  notice  that  the  final  eynnatrie  relationehip  ie  what  we  have  been  looking 
for.  It  involvee  our  probabilities  directly  (e.g.,  <p^  or  through  a co- 
probability  (e.g. , where  <p.*-^<^  + <p-bq>  • 1).  We  are  now  in  a 

position  to  check  the  degree  of  our  probability  astiswtion  consistancy: 


<|i>  + • 


1 

1 4 u}o)um 

‘ ^ (.05)(1-.10) 


...  ■ 

^ ^ ill^SOHkam 

^ (1-.70H.80) 


_L 


1 + 


Hi 

9 


1. 


1 + 


2k 

120 


^ ^ 120 

23  ^ 215 


.950 


which  we  ai^t  identify  as  consistancy  in  the  neasure  of  95X 
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B1CAMPLES  OF  CONSISTENCY  PKOBLEMS 
BETWEEM  A RULE  AND  OTHER  IWFOKMATIOW 


A person  observing  this  sdght  eoasnent  thet  perhaps  <~ip>p  4>  > ,03 
■ight  have  been  better  than  the  .05  actually  used.  It  is  not  easy  to  answer 
questions  about  laprovoMnt,  but  questions  concerning  consistency  can  be 
approached.  The  new  cheek  would  appear  thus: 


<f£>  + <1 


(l-.70)(.80) 


(.03)(1-.10) 


which  indicates  that  the  first  estimation  was  more  consistent.  Since  there 
has  been  no  straddling,  <np>w  qj>  “ .057  is  apt  to  be  quite  nearly  consistent 
with  the  other  three  probability  estimates.  The  miss  is  by  about  IX. 


The  literature  speaks  of  people  endowed  with  special  capacities  to 
estimate  probability.  We  have  here  a specific  test  that  can  be  employed  to  test 
the  ability  to  estisuite  consistently,  if  not  accurately. 


We  comment,  initially,  that  inconsistencies  tend  to  appear  in  the 
form  of  disagreement  between  various  estiamtes  for  the  same  probability.  This 
is  already  apparent  in  the  main  body  of  the  report  irtiere  there  have  been  eases 
of  different  portions  of  the  data  file  leading  to  the  ssmb  statesMnt  with  very 

probability  estimates.  This  occurs  becauaa  the  atatements  used  from  the 
file  amty  vary  wldaly  in  eradlblllty.  In  an  even  deaper  sansa,  it  la  obvious 
that  a diract  clash,  sueh  aa  p and  np  both  balng  In  the  data  file  thus: 

1,  p 

l.-’F 


would  b«  called  a logical  Ineonalataney  in  ordinary  (deductive)  logic;  however  in 
inductive  logic  the  ease  aituation: 

1.  P 
o.  P 

ia  apt  to  be  viewed  aa  a difference  in  probability  evaluation,  or  credibility. 

Next  we  conaider  the  consistency  picture  of  a rule  together  with  a 
fact  statanent : 


(.1,  .9)  p^  q 
.95,  q 

where  we  follow  the  notation  of  paragraphs  3.2.  on. 

.9  ■ <p^  ^ • prob,  (q/p) 

•1  • <*^p*eq^  ■ prob,  (q/np) 

•95  ■ ■ pr<A.  (q) 

SOBM  consideration  leads  us  to  r>tpaet  inconsistency  directly.  One  stateeicnt 
asserts  that  assuming  p (i.a.,  with  its  halp)  tba  truth  probability  of  q is 
90X.  This  appears  to  be  at  odds  with  the  other  statMnt  that  the  truth  prob- 
ability of  q is  95%  without  any  help  at  all. 

The  inconsistaoey  can  be  viewed  formally  by  tha  estiaates  for  <q>. 
Working  with  the  given  rule  alone: 

• <p  ^ ^ -f  <-?  p ^ <n  |> 

• (.9)  <t>  - (.1)  <*np> 

- (.9)  <|>  -f  (.1)  (I-  <^) 

• (.•)  * ,l 

so  that  the  higheat  poeslble  is  ,9,  whereas  the  data  atatCBant  gives 
■ .95.  The  wlaw  of  the  laccBaistancy  cannot  bo  shown  in  a Vann  diagran 
with  probability  areas,  wlaas  wo  violate  serioualy  aowa  of  dM  givwi  infoma- 
tian.  Wa  ahoaa  to  violate  the  <*^p^  ^ • .1  Infomatien.  The  Vann  diagraai, 
than,  way  appear  thua: 
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If  «•  work  with  th«  V«mi  diatraa  attoapt  at  (and  distortioo  of)  tha  Inforaatlon 
and  aatiawta  thua: 


Thos»  glvan  tha  larga  <-rp-w^  • *96  valua  it  la  poaaibla  to  eonputa  tha  valua 
froa  tha  aaaoaad  walua.  Thla  la  tha  ravaraa  dlraetlon  of  eoaputlng 
probability  aatiaataa  aa  eoaparad  with  our  uaual  rula  probability  aathod.  If 
thla  eoaputatlon  had  boon  parforaad  with  tha  original  ■ .1  aaauaip* 

tlon,  than  tha  laeonalataney  would  hava  ahown  up  aa  a <(>  valua  graatar  than  ona 


iCa  on  tha  poaalblllty  of  aueh  an  Ineonalataney 

it  la  raanvad  and  raplaead  by  tha  p atatO' 


ly  ba  halpful.  If  tha  •9St  4 atat< 
nt  with  any  probability  aatiaata,  a.g 


can  nrlaa.  Altomatlvaly,  If  wa  eanaldar  a eontrapoaltlvu  fox*  of  tha  glvan 
rula,  a.g.: 


(.1,  .9)  n q^-ip 
with  .9S,  q 

than  BO  iBConslstoney  can  arlaa,  Thla  rafara  to  an  Ineonalataney  batween  the 
. two  atataaanta  abova:  it  la  yat  anothar  owttar  to  conaldar  an  Inconalatency 

batwaaa  tha  following  two  atataaanta: 

(.1»  ,9)  p^q 
(.1,  19)-iq  w^p 

Ualng  tha  eonalataney  taat  of  Section  1 of  thla  Appendix,  we  obtain  a perfect 

eonalatancy  xaault.  Independent  of  that  teat,  wa  <Aaarva  that: 

> 

«P>  - (.9)  <j>  + (.1)  <-ip> 

<ili>  ■ I»9)  <-i^  "f  (,l) 

irttleh  are  tiia  ralatlonahlpa  noraally  vaad  In  eoa^utlng  the  probability  aatlaate 
for  tha  eonaaquant  of  an  laplleatlon.  Tha  raault  la  that  <i^  ■ ■ 1/2. 

Na  proceed,  now,  with  an  axMpla  of  ineonalataney  anong  aaaantiaUy 
different  rvlaa  (one  rule  not  a eontrapoaltlwa  of  anothar).  Aaauaw  given: 

(0,  .9)  papq 
(0*  »9)  q ^ r 
(0,  .9)  ri^p 

^ iHMdlata  axpaetatloB  of  ineonalataney  devalopa  whan  one  attanpta  a Vann 
di*Sraw  with  probability  arena.  Tha  flrat  two  rulaa  auat  appear  thua: 


(0,  .9)  p^  q 
(0,  .9)  q-^r 


That  Is  to  ssy,  ths  ssro  probability  aatlmataa  «-ip-»<f>  - <-»q-nr>  - 0)  »ean 
that  tha  q truth  sat  is  eomplataly  insida  tha  p truth  sat.  Likawisa,  tha  r 
truth  tat  is  eomplataly  insida  tha  q truth  sat.  Tharafora,  <r -*•(£>  mi»t  aqusl 
unity  instead  of  tha  .9  assumed  in  tha  third  rule. 

A more  typical  example  of  three  such  assumed  rules  follows : 


(.1,  .9)  p -pq 
(.2,  .9)  q^pr 
(.3.  .7)  r-pp 

In  this  ease,  no  ineonsistaney  appears,  as  can  be  scan  by  solving  tha  probability 
aquations : 

<<j>  - .9  <|«>  + .1(1-  <|«>) 

<r>  ■ .9  «f>  + .2(1-  «(>) 

<pO  - .7  <t>  + .3(1-  <t>) 


for  which  tha  solution  is  approximately: 


<(>  - .53 
A .52 
<t>  * .57 

An  attempt  to  do  this  with  tha  earlier  trio  of  rules  would  have  lad  to  a flat 
contradiction,  and  no  possible  solution.  Tha  insights  of  linear  algebra  in  a 
<^,  <4>,  <t>  space  appear  valid.  A Vann  diagram  with  probability  areas 
illustrating  this  last  (and  consistent)  trio  of  rules  follows: 


A PACIMG  SCHEME  FOR  LISP 


Th«  patlng  schcat  will  allow  each  uaar  to  parcaiva  hit  own  virtual 
apaca  of  2^^  words  (131K)  avan  though  ha  la  oparatlng  with  a significantly 
- saallar  alas  of  raal  cora,  probably  on  tha  ordar  of  40K.  This  rasult  can  ba 
accoapllshad  by  allowing  tha  aost  naadad  portions  of  tha  uaar 'a  virtual  apaca 
to  occupy  tfhatavor  cora  apaca  axlsts  whlla  tha  antlra  virtual  apaca  raaldas 
on  drua.  Whanavar  data  not  In  cora  la  naadad  by  tha  uaar,  that  data  la  raad 
froa  drua  Into  whatavar  cora  apaca  la  not  In  usa;  If  all  cora  la  In  uaa,  an 
aqual  slaad,  laast  naadad  aactlon  of  data  from  tha  virtual  apaca  la  ramovad 
from  cora  to  make  room  for  tha  naadad  data.  A tabla  la  usad  to  kaap  track 
of  whara  aach  aactlon  of  virtual  apaca  la  kapt.  In  this  achama,  tha  slsa 
of  tha  aactlon  of  virtual  apaca  la  constant  for  all  usars;  aach  such  aactlon 
la  callad  a virtual  block.  The  counterpart  of  tha  virtual  block  In  core  la 
the  cora  block;  similarly,  tha  counterpart  of  tha  virtual  block  on  drum  la 
tha  drum  block.  While  tha  slxa  of  virtual  and  cora  blocks  la  measured  In 
words,  tha  drum  block  slse  a la  In  sectors.  A page  la  a virtual  block 
allocated  to  tha  user. 

Tha  Page  Tabla 

Each  block  of  virtual  space  has  an  entry  In  tha  Page  Tabla.  Tha 
n^^  entry  of  tha  page  tabla  lists  tha  currant  status  of  virtual  block  n. 

Whan  tha  user  rafarancas  address  t,  tha  paging  system  divides  9 by  tha  page 
alsa  to  give  a page  number  n and  a page  dlsplacamant  d.  Tha  system  looks 
at  tha  n^^  entry  In  tha  Page  Tabla  to  find  whether  tha  page  la  cora>rasldant. 
If  so,  tha  n^^  entry  on  tha  Page  Tabla  will  have  tha  addrasa  a of  the  cora 
block  with  which  page  n la  Identified.  Tha  system  than  reports  to  the  user 
program  tha  raal  addrasa  of  I,  namely  a d. 

Paaa  fault 

If  page  n la  not  cora-rasldant,  than  It  can  ba  found  on  tha  drum. 

Tha  uaar'a  space  on  tha  drum  la  Identical  to  tha  virtual  apace.  In  tha  foil 
lag  mamnari  virtual  block  n la  Identified  with  drum  block  a where  drua  block 
a la  daflaad  as  rasldlag  on  tha  a sectors  starting  with  sector  as. 
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Now  a plact  Bust  be  found  for  page  n to  occupy  real  core.  Flret, 
the  Available  Core  Block  Pointer  la  consulted  to  see  If  a free  core  block 
Is  available.  If  so»  the  Available  Core  Block  Pointer  Is  changed  to  point 
to  the  next  core  block  In  the  Available  Core  Block  Stack  *od  page  n Is  read 
Into  core  to  occupy  the  available  core  block  found.  The  Page  Table  Is  up- 
dated to  reflect  the  change  In  page  n's  status. 

If  no  core  blocks  are  available,  a page  aust  be  reaoved  from 
core  to  Bake  rooB  for  page  n.  Let  us  suppose  we  have  deteralned  page  p 
has  to  go  and  so  relinquishes  Its  use  of  core  block  b.  Page  p Is  written 
out  froB  core  onto  the  drua  and  Its  Page  Table  entry  reflects  Its  change 
of  location.  Page  n's  Page  Table  entry  Is  updated  to  show  Its  acquisition 
of  core  block  b and  page  n Is  read  Into  block  b la  core. 

Paae  ReplaceBent  Algorltha 

Tha  question  still  reaslns  as  to  how  the  systen  decides  which  core- 
rasldent  page  Bust  leave  when  a Page  Fault  occurs  and  no  core  blocks  arc 
available.  First,  the  list  of  pages  eligible  for  rcplaceaent  Is  reduced  by 
tha  Page  Lock  Feature;  any  page  with  Its  Page  Lock  "on"  Is  not  eligible  for 
raplacaBcnt. 

The  final  decision  Is  Bade  using  the  Weight  Counter  stored  In  the 
Page  Table  for  each  core-resldant  page.  Basically,  every  tlac  a core-resident 
peg*  ^ raferancad  Its  Weight  Counter  Is  IncrsBented.  So,  the  Weight  Counter 
reflects  the  frequency  of  rafarencas  to  that  page.  When  a page  Bust  be  selected 
for  replecaBent,  the  systaa  scans  the  Weight  Counters  of  all  the  (core-resident) 
pages  to  find  the  page  with  the  lowest  Weight  Counter;  this  Is  the  page  to  be 
replaced. 

How,  the  question  Is  how  Buch  should  a Weight  Counter  be  IncrcBcntcd 
for  a page  reference?  If  the  IncreBaat  Is  a constant  value,  then  the  Weight 
Ceontar  does  not  reflect  the  currant  need  for  the  page  In  cor*.  For  axsBple, 
ovppose  that  over  tha  lest  10,000  page  references,  page  1 has  been  referenced 
94  tlass  while  page  5 he*  been  referenced  75  tines.  Let  us  further  suppose 
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that  all  of  page  I'a  rafarancas  occurrad  ovar  5,000  paga  rafarancaa  ago  (using 

paga  rafaranca  as  a unit  of  tins)  whila  all  of  paga  S's  rafarancas  occurrad 
B 

no  Bora  than  500  paga  rafarancas  ago.  It  would  saaa  raasonabla  that,  although 
. ovar  tha  last  10,000  rafarancas  paga  1 has  baan  rafarancad  aora  fraquantly, 
paga  5 has  a battar  casa  for  rasalnlng  in  cora  bacausa  its  rafarancas  wars 
aora  racant  and,  so,  aora  closaly  raflact  the  currant  needs  of  tha  user. 

Thus,  paga  rafarancas  that  occurrad  aora  recently  should  have  higher  incra- 
aents  or  weights  than  those  that  occurrad  further  in  tha  past. 


Tha  function  chosen  as  tha  basis  for  tha  page  rafaranca  weight 
systaa  is  an  axponantlal  decay  function  of  the  fora  2~'*.  Specifically, 
w(r)  ■ 2**'^*  is  tha  weight  of  a paga  rafaranca  which  occurred  r page  refer- 
ancas  ago  where  a is  sons  positive  constant.  Clearly,  function  w satisfies 
our  currency  need  that  w(x)  > w(y)  where  y > x o. 

Using  tha  results  of  slstulation  studies  by  Chu  and  Opdarbeck^,  an 
astiaata  was  aada  that  our  paging  systaa  could  expect  approxiaataly  1 Page 
Fault  for  every  10,000  paga  rafarancas.  Hence,  a paga  reference  occurring 
10,000  paga  rafarancas  ago  should  have  a weight  close  to  zero.  W(10,000) 
was  sat  equal  to  1/16.  So,  our  basis  weight  function  was  defined  as  w(r)  ■ 
I 2“'^*  where  a - 2500. 


For  coaputational  reasons,  tha  function  w(r)  has  to  ba  siaulatad 
using  a step  function  s(x)  in  tha  following  aannar: 

Let  X ba  the  x^^  paga  rafaranca  after  tha  aost  racant  Paga  Fault. 
Than,  s(x)  • 1 for  0 < x ^ K 

-2  for  K<x<K-fa 

■ 4 for  K + a<x£  K+2a 

• 2®  for  K (n-1)  a < x£  K y an 
whara  K la  a function  of  a 

A running  count  is  kapt  of  x.  As  aach  paga  rafaranca  occurs,  x is  incraasad 
by  1 and  a(x)  la  addad  to  tha  Haight  Countar  of  tha  page  rafarancad.  Whan  a 
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Page  Fault  occurs,  a Factorization  process  Is  activated  after  the  page  to 
be  replaced  is  found.  The  Fsctorizatlon  process  merely  divides  each 
Weight  Counter  by  the  current  s(x).  x is  then  reinitialized  to  zero  and  the 
paging  system  continues.  In  order  to  simulate  v(r),  s(x)  is  restricted  so 
that  when  a Page  Fault  occurs  at  x ■ an  for  n ^ 1,  the  sum  of  the  weights  of 


•11  page  references  from  one  to  an  inclusive  is  the  same  when  calculated  with 
s(x)  as  with  w(r).  That  is,  ^ w(r)dr  for  all  n ^ 1.  S(x)  satis- 

x»l  - o 

fles  this  condition  when  1C  ■ a (2  - Wth  a ■ 2500,  K " 1393.  K is  called 

Paging  Parameter. K.  A is  called  Paging  Parameter  A.  X is  the  Page  Reference 

Countdown. 


In  order  to  insure  that  a page  Just  brought  into  core  due  to  a Page 
Fault  does  not  get  replaced  before  it  has  a chance  to  accumulate  page  references, 
each  page  has  its  Weight  Counter  set  to  s Page  Bonus  value  when  it  is  brought 
into  core.  (Since  locked  pages  are  not  eligible  for  replacement,  references 
to  such  pages  are  ignored  in  the  Weight  Counter  portion  of  the  paging  system.) 
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IMPLEMEWTAnOW  WELDS 


FUlds 


Pag*  Sis*  * lUJBbar  of  vord*/p*g*;  must  b*  * power  of  2 
Cor*  Six*  “ Duaibar  of  cor*  blocks 

Paging  Paraaatar  K ■ numbar  of  pag*  raferancas  with  weight  1 
Paging  Paramatar  A * ntanbar  of  pag*  raferancas  with  weight 

whar*  n ^ 1 

Pag*  Bonus  ■ Initial  value  of  a pag* 'a  Weight  Counter 
whan  th*  page  bacomaa  core-rasldant 
Virtual  Sis*  ■ number  of  blocks  In  virtual  address  space  ■ maximum 
nus^ar  of  pagas  In  Initial  memory 
Drum  Factor  ■ nusibar  of  sactors  per  pag* 


User  Field*  (1  such  field  for  each  user) 

Pag*  Table  - array  of  virtual  block  status  entries 

Pag*  Reference  Countdown  - number  of  page  references  until  weight 

Is  Incraasad 

Weight  - n»ber  added  to  page's  Weight  Countar  whan  pag*  Is  refer- 
encad 


Factor  - number  of  bits  each  page's  Weight  Counter  is  shifted  to 
th*  right  during  Factorisation 
Weight  • 2 me  all  times. 


Pat*  Table 


The  Page  Table  la  an  array  of  entries » one  for  each  block  In  virtual 
memory.  Each  entry  record*  the  current  status  of  a virtual  block.  Th*  number 
of  entrlas  equals  2^^/Pags  Sis*. 

Bach  Page  Table  entry  will  appear  different  according  to  th*  paging 
status  of  the  virtual  block 


I 


A)  Unallocated  virtual  block 


35  34  18  17  12  11  0 


Available  Virtual  Block  Pointer  ■ negative  value  of  virtual  block 

on  Available  Virtual  Block  Stack 
- If  this  virtual  block  Is  the 
last  In  the  Available  Virtual 
Block  Stack,  then  this  field  con- 
tains the  virtual  block  number 
associated  with  this  entry 
(e.g.,  if  virtual  block  6 Is  the 
last  ^rtual  block  In  the  Avail- 
able Virtual  Block  Stack,  Its 
Available  Virtual  Block  Pointer 
contains  the  value  -6) 


B)  Page  that  Is  out  on  drum 


I 35  34  18  17  12  11  0 


35  34  18  17  12  11  0 


Page  Lock  ■ 1 If  page  must  he  core-resident 

■ 0 If  page  is  not  required  to  be  core-resident 

Height  Counter  ■ weighted  count  of  maiber  of  page  references 
CO  this  page  since  becoming  core-resident 

Block  Mu^er  ■ nurt>er  of  block  this  page  occupies  In  core;  the 


real  address  of  the  core  block  can  be  obtained 
by  ahlftiag  the  block  nuhber  n bits  to  the  left 
where  2*^  is  the  page  site 


Avllabl*  Block  Sf  ck 


A puahdovn  stack  for  each  uaar  Is  kept  to  record  the  blocks  available 
to  that  user  In  core.  The  atack  is  structured  as  follows: 

Available  Core  Block  Pointer  contains  the  address  of  a block 
available  in  core.  If  no  blocks  are  available,  the  contents 
of  the  Available  Core  Block  Pointer  is  sero. 

In  turn,  the  first  word  of  the  core  block  pointed  to  by  the 
Available  Core  Block  Pointer  contains  tha  address  of  the 
nest  available  core  block.  If  there  are  no  aore  core  blocks 
available,  the  first  word  contains  saro. 

In  this  aanner,  all  availabla  core  blocka  are  listed  on  this 
single- threaded  que^. 

When  i:he  user  needs  an  available  core  block,  the  user  is  given  the 
first  block  on  the  stack  and  tha  Availabla  Core  Block  Pointer  is  changed  to 
point  to  the  next  block  on  the  stack.  When  a core  block  is  nade  availabla, 
that  block's  first  word  is  sat  to  point  to  tha  first  block  on  the  stack  and 
tha  Available  Core  Block  Pointer  is  changed  to  point  to  the  newly  available 
core  block. 

Available  Pate  Stack 

A puahdown  stack  for  aach  user  is  kept  to  record  the  blocks  avail- 
able to  that  user  in  his' virtual  space.  The  stack  is  structured  as  follows: 

•V 

The  Systan  Availabla  Virtual  Block  Pointer  contains 
tha  number  of  an  availabla  block  in  virtual  space. 

If  no  such  blocks  are  available,  tha  content  of  the 
Systea  Available  Virtual  Block  Pointer  is  saro. 

Tha  Page  Table  entry  of  an  available  virtual  block  has 
an  Available  Virtual  Block  Pointer  to  record  tbs  next 
virtual  block  in  the  Stack.  If  no  nore  blocks  are  avail- 
ble,  the  Available  Virtual  Block  Pointer  points  to  itself. 
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In  Muincr,  «11  avallablt  ▼Irtual  block* 
listed  on  this  ■ Ingle- thr««d*d  queue. 
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Appendix  F deteiled  • paging  nebaaa  ■odlficatlon  to  Dniaae  1100  LISP. 
The  paging  achaaa  Included  an  algoricfaa  to  datarulna  which  page  la  to  be  ra> 
placed  In  tha  event  of  a Page  Fault.  Thla  paper  preaenta  an  alternate  algorltba 
which  can  be  uaed  within  the  franework  of  tha  paging  achane  prevloualy  preaented. 
Thla  elgorlthn  la  the  ao-called  Leaat  lecently  Dead  (LSD)  algorlthn.  A conparl- 
aon  of  the  two  algorltfana  will  be  preaented  at  the  conclualon  of  thla  paper. 

All  deflnltlona  and  date  atructurea  froa  Appendix  F are  retained  unleaa  apecl- 
flcally  noted. 

The  LSD  Alaorlthn 

In  the  LSD  algor Itfan,  tha  page  nunber  of  each  core>realdent  page 
la  poaltloned  la  a puahdown  atack  according  to  how  recently  the  page  waa 
referenced  with  the  leaat  recently  referenced  page  at  the  botton  of  the 
atack.  So,  whenever  a page  la  referenced,  Ita  page  nunber  la  ranovad  fron 
Ita  current  poaltlon  In  the  atack  and  placad  at  the  top.  When  a page  auat 
be  replaced,  the  page  ehoaan  for  replacaaent  la  the  one  at  the  botton  of 
the  atack;  the  page  brought  Into  core  la  poaltloned  at  the  top  of  the  atack. 

Chanaea  in  Ihelanentatlon  Structure 

Dalng  the  LSD  algorithm,  the  following  ayaten  flelda  are  not  needed: 
Paging  Par  ■water  A,  Paging  Paraaatar  K,  Page  Bonua.  The  following  uaer  flelda 
era  alao  not  naadadt  Factor,  Weight,  Page  Saferanca  Countdown.  The  Weight 
Counter  flelda  la  tha  Page  Ihbla  will  be  referred  to  aa  Saferanca  Ruaber  flelda. 

A aiagla  Wext  Saference  Svniber  field  will  be  needed  for  each  uaer.  The  aya- 
tew  will  alao  naad  a fyotew  Shift  Paeter  field. 

leelawanutiop  AlsoFltk» 

Whan  a near  bogiaa,  hla  last  Saference  Kmiber  ia  initialiaed  to  aero. 
All  Safaraaee  Sahar  f ialdo  have  the  highaat  naabar  they  can  hold  (l.e. , 2^^  - 1) . 
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Whenever  e peg*  !■  referenced,  the  Next  Reference  Nunber  value  is 
pieced  In  the  Reference  Number  field  of  the  appropriate  Page  Table  entry. 

The  Next  Reference  Number  ia  then  incremented  by  1 and  the  paging  system  con- 
tinues. 

Whenever  a page  must  be  replaced,  the  Page  Table  is  scanned  to  find 
the  page  with  the  lowest  Reference  Nu^er.  This  is  the  page  least  recently 
used  and  is  the  one  paged  out;  its  Reference  Ntmiber  field  is  set  to  the  highest 
value,  2^^-  1 and  the  Page  Lock  bit  is  also  set  to  1.  The  page  being  paged 
ia  has  its  Reference  Number  set  to  the  value  of  the  Next  Reference  Number.  The 
Next  Reference  Number  is  incremented  by  1 and  the  paging  system  continues. 

Whenever  the  Next  Reference  Number  has  the  value  2^^  - 1 before  being 
incremented,  a Factorisation  process  is  set  into  notion  to  forestall  the  over- 
flow situation.  Bach  page's  Reference  Nusdier  field  is  shifted  n bits  to  the 
1 right  as  is  the  Next  -Reference  Number  as  well.  The  number  n is  the  System 

Shift  Factor.  If  n ■ 3,  then  Factorisation  will  have  to  be  performed  only  once 
for  every  115,000  page  references. 

Comparison  of  Algorithms 

In  terms  of  the  speed  in  the  operation  of  the  algorithms  themselves, 
the  LRU  algorithm  would  seem  to  have  the  edge.  In  processing  the  ordinary  page 
reference,  the  LRU  algorithm  does  not  have  to  perform  as  many  arithmetic  addi- 
tions nor  does  it  have  to  make  as  many  comparison  tests.  When  a page  replace- 
ment is  called  for,  the  LRU  algorithm  has  only  to  perform  one  comparison  for 
each  entry  in  the  Page  Table  while  the  Weight  Counter  algorithm  performs  a com- 
parison plus  a shift  for  each  entry.  Beth  algorithms  perform  equally  as  fast 
in  the  overflow  situation,  lowever,  the  LRU  algorithm  will  encounter  the  over- 
flew situation  once  every  115,000  page  references  (when  the  System  Shift 
Factor  ■ 3).  On  the  ether  hand.  If  Paging  PermMter  A ■ 2500,  core  sise  > 80 
pages,  and  the  Page  Fault  Frequency  (i.e.,  page  faults  per  page  reference)  is 
greater  than  1/25,000,  evarflow  situations  should  almost  never  occur. 

On  the  irtMle,  the  algorithms  should  give  quite  similar  recomMndations 
] of  pages  for  replaeameet.  Still,  there  are  differences.  While  the  Weight  Counter 


✓ 


j 


algorltha  oiphaslsas  both  curroncy  and  fraquancy,  tha  LRU  algor Itha  ref lac ta 
only  currancy.  Since  currency  la  not  balanced  with  frequency  In  the  LRU,  we 
can  expact  the  LRU  to  sore  cloaely  reflect  the  current  needa  of  the  uaer  with 
no  regard  for  any  hlatorical  conalderatlona  of  paat  need.  The  Weight  Counter 
algorltha  will  be  aore  aoderate  In  Ita  regard  for  the  fad  of  the  day.  In  aoae 
olr@iMtancea,  though,  tha  Weight  Counter  only  reflects  frequency.  The  Weight 
Counter  algor Itha  becauae  of  Ite  atep  function  baaia  haa  the  characteristic 
that  over  periods  of  high  Page  Fault  Frequency  on  the  order  of  1/Paglng  Para- 
aeter  K (e.g.,  1/1,400  If  Paging  ParasMter  k ■ 2500)  or  aore  no  regard  at  all 
Is  aade  for  currency;  the  algoritha  sees  all  page  references  with  equal  weight 
and,  ao,  frequency  rules  supreae. 


(The  ravaraa  of  this  page  la  blank) 
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Rome  Air  Development  Center 


jure  plMBB  and  eondueta  rmsaareh,  •spioratory  and  advanead 
davaiofMRt  pzoyrajM  in  ooNMatf#  eentxol#  antf  eoMunicationa 
aceiritiM,  and  in  eiw  C*  araaa  of  iafiasMtioK.  aeianoaa 
and  itttmlUganea.  tha  principal  taebnieal  aiaaion  araaa 
arm  eoaaaanicationaf  al aetroamgnatie  gaidanea  and  aeatxalr 
auraaiUanea  of  yround  and  aaroapaoa  cbjaetat  intalligaoea 
data  eoUaetion  and  handling,  intoraatien  agatam  taehnology, 
ienoaphmeie  propagation,  aoUd  atata  aeianoaa,  aieremaaa 
pbgaiea  and  alaetronie  raliabilitg,  malntainahilitg  and 
eeatpatihilitg. 
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